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APPENDIX  A 

ORIENTATION  INTERVIEW  ANALYSIS 


I.  PURPOSE  OF  INTERVIEWS 

Orientation  interviews  were  undertaken  during  the  Phase 
I  activity  to  accomplish  the  following  objectives: 

(a)  identify  key  personnel  with  valid  engine  maintenance 
management  background,  experience  and  responsibility; 

(b)  formulate  relevant  and  valid  operating  scenarios  for 
the  survey; 

(c)  familiarize  management  at  targeted  base,  ALC,  HQAFLC, 
and  MAJCOM  centers  within  the  TEFDI  program. 

Members  of  the  program  team  interviewed  key  Air  Force  person¬ 
nel  at  the  target  organizations  listed  in  Table  1.  Personnel 
selection  at  each  site  was  limited  by  scheduling  requirements. 

A  reasonable  cross  section  of  viewpoints  was  solicited  and  the 
response  at  each  site  was  excellent.  In  the  following  summaries, 
the  opinions  of  the  interviewees  are  presented. 

1.1  BASE  ORIENTATION  MEETINGS 

Base  orientation  meetings  were  held  at  1  TFW,  Langley  AFB 
and  354TFW,  Myrtle  Beach  AFB.  The  objectives  of  the  meetings 
were  as  follows: 

(1)  Types  of  maintenance  decisions  that  are  being  made 
at  the  base  level. 

(2)  Frequency  and  priority  of  base  level  engine  maintenance 
procedures . 

(3)  Information  currently  utilized  at  the  base  level  to 
make  engine  maintenance  decisions. 

(4)  Format  and  accessibility  of  engine  management  informa¬ 
tion. 
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Table  1 


Organizations  Targeted  for  Orientation  Interviews 


ORGANIZATION 

LOCATION 

ACTIVITY 

1  TFW 

Langley  AFB 

FI  5  Base 

354  TFW 

Myrtle  Beach  AFB 

A10  Base 

San  Antonio  ALC 

Kelly  AFB 

Engine  Depot 

Oklahoma  City  ALC 

Tinker  AFB 

Data  Service  Center 

HQTAC 

Langley  AFB 

Major  Command 

HQAFLC 


Wright  Patterson  AFB 


Headquarters 


1.2  MAJOR  COMMAND  ORIENTATION  MEETINGS 


Orientation  meetings  were  held  at  TAC  headquarters,  Langley 
AFB  and  with  personnel  experienced  with  SAC/MAC/ADC  procedures 
who  are  currently  assigned  to  HQAFLC,  WPAFB. 


Objectives  for  Meeting  with  HQTAC  Personnel 

The  following  items  will  be  explored  with  cognizant  personnel: 

(1)  Impact  of  TAC ' s  mission  on  maintenance  and  engine 
management  procedures. 

(2)  On-going  condition  monitoring  programs. 

(3)  Experiences  with  on-condition  maintenance  and  engine 
moni tor ing . 

(4)  Operational  obstacles  to  the  implementation  of  automated 
turbine  engine  monitoring  at  the  base  level. 

(5)  Performance  factors  that  are  tracked  at  the  TAC  command 
level  (e.g.,  sortie  rate,  NRTS,  maintenance  man  hours 
per  operating  hour,  etc.). 

(6)  Information  currently  available  for  formulating  and 
tracking  these  performance  factors. 

(7)  Format  and  accessibility  of  engine  management  information. 


Objectives  for  Meetings  with  SAC/MAC/ADC  Personnel: 

(1)  Impact  of  the  respective  command's  mission  on  maintenance 
and  engine  management  procedures  and  policy. 

(2)  On-going  condition  monitoring  programs. 

(3)  Automated  turbine  engine  monitoring  and  its  impact 
on  base  level  operations. 

(4)  Operational  obstacles  to  the  implementation  of  automated 
turbine  engine  monitoring. 

(5)  Information  currently  utilized  to  make  engine  maintenance 
deci s ions . 

Format  and  accessibility  of  engine  management  information. 
Experience  with  MMICS. 


A- 3 


(6) 

(7) 


II.  INTERVIEW  RESULTS 


Both  discussion  sessions  and  personal  interviews  were  completed 
at  each  target  organization.  The  following  sections  document 
these  results. 

2.1  BASE  LEVEL 

2.1.1  Discussion  Analysis 

Based  on  information  obtained  during  base  level  orientation 
discussions,  certain  key  issues  for  automated  engine  monitoring 
and  maintenance/logistics  management  have  been  identified. 

These  issues  will  impact  the  system  requirements  generated  in 
Phase  I. 

(1)  Base  Level  Operations  --  The  requirements  of  the  users 
at  the  base  level  will  drive  the  system  requirements  for  turbine 
engine  monitoring.  This  applies  particularly  to  the  format 
of  data,  hardware  capability  and  the  update  frequency.  The 
base  appears  to  be  the  best  place  to  manage  the  individual  engines. 
The  ability  for  base  personnel  to  diagnose  and  isolate  engine 
faults  is  a  cri tical  requirement  for  the  generic  TEMS.  In  order 
to  exploit  the  modular  engines,  e.g.,  the  F100,  tnis  isolation 
must  be  to  the  module  level.  Last  year,  120  assembled  FlOO's 
were  transported  to  SAALC  for  maintenance.  A  significant  portion 
of  these  returns  could  be  attributed  to  the  bases'  inability 
to  isolate  the  engine  fault. 

Currently,  the  only  information  used  to  manage  engines 
are  LCF  counts,  operating  hours,  and  diagnostic  signatures. 

This  information  needs  to  be  cross-referenced  to  engine  serial 
number,  aircraft  tail  number,  base  location  and  Julian  date. 

Multiple  signature  spreads,  trends,  and  other  information  (e.g., 

GPA,  SOAP,  vibration  history)  would  be  available  to  users  on 
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an  exception  basis.  It  will  be  important  to  determine  which 
base  level  personnel  need  to  interrogate  the  system  and  determine 
which  portions  of  the  data  base  they  can  access. 

It  is  anticipated  that  the  major  impact  of  automated  engine 
monitoring  will  be  felt  at  the  base  level.  The  system  requirements 
should  address  the  constraints  of  the  base  operating  environment 
(e.g.,  limited  manpower,  level  of  skill,  man-machine  interface, 
etc .  ) . 

(2)  MMICS  Experience  --  The  Air  Force  experience  developing 
and  implementing  the  base  level  MMICS  processor  underscore  the 
criticality  of  integrating  base  level  hardware/software  requirements. 
The  information  capabilities  of  MMICS  impact  interface  requirements 
for  automated  monitoring. 

2.1.2  Personal  Interviews 

2. 1.2.1  Data  Processing  Specialist 

(1)  Profile:  This  USAF  Major  has  extensive  experience 

in  maintenance  policy/procedure  development  regarding  data  process¬ 
ing  requirements  dating  from  C4016  system.  At  TAC,  he  developed 
engine  tracking  procedures  unique  to  the  command  and  was  involved 
with  base  level  processing  until  MMICS  came  on  board.  He  has 
been  in  automated  systems  management  for  hardware,  weapon  system, 
MAJCOM,  and  field  level  applications. 

(2)  Data  System  Requirements  and  Observations: 

(a)  MMICS  interface  with  OCALC  data  bank  creates 
problems  with  compatibility,  especially  of  data 
edits  at  two  locations.  Base  level  system  keeps 
time  change  item  responsibility,  tracked  components, 
configuration  management  and  life  consumed. 

(b)  Time  change  tracking  system  at  Langley  requires 
685000  disc  segments  for  MMICS.  Updates  come 
towards  from  flightline  via  EHR  inputs,  and  manual 
cycles.  Every  transaction  is  transferred  to 
OCALC  daily  via  AUTODIN.  Base  records  encompass 
approximately  the  last  90  days  of  data. 
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(c)  Information  required  at  base  involves  time  change 
forecasts  and  all  parts  linked  to  next  higher 
assembly  for  ease  in  location. 

(d)  Base  experience  and  success  with  MMICS  ranges 
from  excellent  to  very  poor,  depending  on  local 
base  management  support. 

2. 1.2.2  HQTAC  Base  Engine  Troubleshooter 


(1)  Profile:  This  SMSgt  has  extensive  experience  in  engine 
maintenance  starting  in  1961.  He  was  a  field  instructor  for 
nine  years  on  the  J79,  J56,  J33,  J57,  TF41,  TF30.  He  has  had 
extensive  Fill  (TF30)  experience  in  fighter  wing,  test  cell, 
trim  pad  and  JEIM  activity.  Recently  has  had  been  working  F100 
problems  extensively. 

(2)  Observations  on  maintenance  information  requirements: 

(a)  The  F100  is  basically  a  "good  engine"  with  support 
ability  problems.  They  are  currently  shooting 
for  95*  availability  and  at  94.3%  depot  return 
rate  from  JEIM.  They  are  currently  using  the 
following  AGE: 

•  SCS  tester  (supervisory  control) 

•  trim  box 

•  SOAP 

•  Looking  at  EMS  manual  performance  system. 

(b)  His  information  "wish"  list  for  troubleshooting 
includes : 

•  FTIT  clicks  and  margin 

•  FTIT  spread 

•  rate  of  disc  usage 

•  borescope  inspection  results. 

(c)  Currently,  engines  are  being  trimmed  every  60 
operating  hours  with  depot  returns  averaging 
400  hours. 
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(d)  He  believes  EDS  would  give  the  Air  Force  the 
opportunity  to  do  preventive  maintenance  to  avoid 
catastrophic  failure,  to  be  "smarter"  in  trimming 
and  fault  isolation. 

(e)  Gas  path  deterioration  analysis  should  allow 
the  engine  to  run  to  a  point  where  it  needs  to 
be  pulled.  Sensor  failures  must  be  discovered 
without  generating  anamolous  maintenance  requests. 

(f)  There  is  a  major  problem  currently  with  F100 
parts  tracking  because  approximately  every  third 
component  is  cannibalized  from  other  engines. 

This  causes  tracking  system  accuracy  problems. 

(g)  Opportunistic  build  is  an  interesting  future 
concept  with  a  validated  gas  path  capability 

and  modular  engines.  Establishing  module  perfor¬ 
mance  level  on  depot  return  is  a  problem,  since 
no  test  cell  data  is  available. 

2. 1.2.3  TAC  Engine  Manager 

(1)  Profile:  Sgt.  has  experience  in  engine  management 
specified  in  AFM  400-1. 

(a)  Engine  managers  are  not  required  to  be  cognizant 
of  engine  maintenance  procedures. 

(b)  The  prime  responsibility  is  to  maintain  accurate 
engine  status  information  using  AFTO  1534  forms 
input  to  the  OCALC  D024  system. 

(c)  Currently  TAC  reports  status  in  following  categor¬ 
ies  : 

•  serviceable  spare 

•  build  up 

•  maintenance 

•  awaiting  maintenance 

•  RAW 

•  ENMCS 

(d)  Other  engine  manager  responsibilities  include 
spare  levels,  war  reserve,  pipeline  information 
inputs  and  resupply  status. 
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2. 1.2.4  Base  Propulsion  Maintenance  Specialist 


(1)  Profile:  This  MSgt  has  experience  working  "about 
every"  engine  owned  by  the  Air  Force  over  the  past  twenty  years. 
Specialties  include  wing  maintenance  efficiency  analysis,  and 
production.  Recently  he  has  worked  the  LWF  and  YF16  and  YF17 
programs  at  Edwards  AFB,  the  F16  acquisition,  J79  program  develop¬ 
ment  and  F100  engine  problems. 

(2)  Comments  on  maintenance  information  requirements: 

(a)  The  system  should  be  totally  integrated.  It 
should  be  usable  by  all  base  personnel  down  to 
the  Airman  3  level  at  the  line. 

(b)  Currently  expertise  is  being  lost  at  the  base 
because  the  tech  data  is  not  equal  to  the  weapon 
system  requirements  and  training  is  not  commensur¬ 
ate  with  the  problem. 

(c)  The  automated  system  is  not  the  end  item.  Its 
design  should  understand  the  user's  problem  and 
let  the  user  know  about  the  problems  of  other 
users . 

(d)  Outputs  should  be  formatted  so  that  the  maintenance 
person  can  interrogate  the  system  at  his  level 

and  utilize  his  experience.  Give  him  the  informa¬ 
tion  but  let  him  make  up  the  story. 

2.2  AIR  LOGISTICS  CENTER 


2.2.1  Discussion  Analysis 


San  Antonio  ALC 

(U  SA-ALC  is  responsible  for  the  repair  and  overhaul 
of  the  T56,  FIDO,  J79,  TF30,  and  TF39  engines.  The  large  U- 
shaped  building  used  for  maintenance  was  designed  for  the  overhaul 
process  (complete  disassembly  and  repair!.  An  engine  enters 
through  one  wing  of  the  building  and  is  routed  through  disassembly, 
cleaning,  inspection,  rework,  assembly  and  is  shipped  through 
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the  opposite  wing.  Modification  will  be  required  to  redistribute 
work  stations  to  make  the  facility  better  equipped  for  OCM. 

Currently,  the  F100  is  the  only  engine  maintained  by  OCM.  Other 
engines  are  slated  to  be  changed  over  in  the  next  two  years. 

(2)  The  monthly  work  production  quota  for  the  F100  are 
6  engines,  6  fans,  28  cores,  8  turbines,  6  gearboxes,  10  augmen- 
tors,  12  high  pressure  turbines.  The  depot  is  requi red  to  meet 
this  production  schedule. 

(3)  On-Condition  Maintenance  --  The  objective  of  on-condition 
(or  conditional)  maintenance  is  to  specify  the  repairs  that 
are  necessary  to  return  an  engine  or  module  to  serviceable  condition 

(i.e.,  complies  with  established  mission  and  safety  standards),  .-j 

The  performance  of  outstanding  non-urgent  TCTO's  or  other  opportun¬ 
istic  maintenance  on  life  limited  components  should  only  be 
prescribed  when  economical  (e.g.,  when  the  engine  is  already 
disassembled  to  the  level  necessary  to  perform  the  additional 
work).  In  order  to  effectively  implement  this  maintenance  concept, 
the  OCM  team  needs  specific  information  on  each  engine/module 
returned  for  depot  repair.  A  list  of  items  was  suggested  as 
candidates  for  inclusion  in  the  OCM  oriented  iformational  displays. 

They  include: 

•  removal  reason  and  nature  of  malfunction 

•  diagnostic  analysis 

•  over temperature  bands 

•  FTIT  out  of  band 

•  performance  trends 

•  borescope  and  test  stand  reports 

•  vibration  history 

•  SOAP 

•  maintenance  history 

•  outstanding  TCTO 

•  balance  of  life  on  any  time/cycle  limited  components 
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It  will  be  essential  to  correlate  the  engine  performance 
information  via  GPA  with  historic  maintenance  actions.  This 
is  the  first  step  in  establishing  symptom/cause  relationships 
to  support  the  concept  of  OCM. 

(4)  An  OCM  team  was  observed  during  an  evaluation  session. 

The  team  indicated  that  the  maintenance  history  was  currently 
the  most  important  factor  in  their  decision  process.  The  G337 
products  were  referenced  as  needed.  They  felt  if  more  comprehen¬ 
sive  information  were  available  on  an  individual  basis,  it  would 
greatly  improve  the  OCM  process.  Scheduling  and  the  production 
quota  seemed  to  be  the  drivers  of  the  amount  of  opportunistic 
maintenance  that  was  prescribed. 

Oklahoma  City  ALC 

(1)  All  concerned  were  convinced  that  engine  diagnostics 
and  trending  could  successfully  be  used  to  predict  imminent 
engine  failures,  reduce  secondary  damage  and  reduce  unscheduled 
maintenance.  The  statement  was  made  that  SAC  has  documented 
100/100  "hits"  in  predicting  incipient  failure  based  on  tracking 
EGT's,  EPR's,  TSFC ,  RPM,  etc. 

(2)  Currently  OCM  is  being  used  at  OCALC  on  the  J57  (B52 

§  KC135)  and  the  TF30-P3.  Some  problems  with  data  interpretation 
have  been  experienced.  A  lot  of  the  diagnostic  work  is  post 
failure  analysis.  No  OCM  or  trending  is  currently  done  on  the 
TF34  or  TF41.  LCF  and  hot  time,  reporting  are  the  primary  monitor¬ 
ing  parameters. 

(3)  The  major  TF30  failure  modes  are  currently: 

(a)  Fan  Blade  Failure  Disk  §  Hub  Cracking 

(b)  #1  Compressor  outer  burner  case  rupture 

(c)  Air  Seals  on  Compressor  Blades 

(4)  Current  TF30  procedures  are  to  track  accumulated  hours 
by  S/N  at  the  component  level.  For  these  principal  components. 


A  - 1 0 


f 


"K-Factors"  which  relate  accumulated  hours  to  flight  equivalent 
hours  are  being  developed.  For  example,  1  hour  in  the  test 
cell  during  AMT  testing  might  be  equivalent  to  2.35  flight  hours 
on  the  fan  blades. 

(5)  A  general  comment  was  made  regarding  data  systems 
generated  by  AFLC  in  the  past.  It  was  felt  that  previous  systems 
were  too  tailored  towards  data  and  information  needed  for  logistics 
management.  The  survey  questions  should  be  carefully  designed 
to  specifically  isolate  the  different  data  and  information  needs 
at  each  level  --  depot,  base  and  logistics,  maybe  even  to  the 
point  of  asking  each  user  what  his  view  of  the  differences  in 
requirements  are. 

2.2.2  Persoral  Interviews 


ALC  Management 

Comments  concerning  maintenance  information  systems  and 
integration  of  automated  data  acquisition  and  performance  analysis 
were  solicited  from  the  ALC  operational  management  supervisor. 

(1)  Deployment  and  particularly  which  aircraft,  installed 
engines  and  engine  spares  to  send  is  an  important  operating 
scenario.  Another  important  issue  is  the  deployed  G337  system. 

(2)  The  "age  of  data”  requirement  will  impact  how  frequently 
the  base  level  data  base  will  be  updated.  It  will  also  impact 

the  format  in  which  the  data  is  displayed.  AFLC  personnel  experi¬ 
enced  with  managing  the  engine  inventory  at  MAC  indicated  that 
the  update  frequency  should  be  24  hours. 

(3)  99%  of  the  time  tne  only  information  required  to  manage 
engines  are  LCF  counts,  operating  hours,  diagnostics  signatures, 
and  cross  reference  of  the  engine  serial  number  to  aircraft 

tail  number,  base  location,  and  Julian  date.  Multiple  signature 
spreads,  trends  and  other  information  would  be  available  to 
selected  users  only  on  an  exception  basis. 
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(4)  It  will  be  important  to  identify  any  problems  with 
the  G337/MMICS  interface.  Some  of  the  current  problems  are 
probably  linked  to  the  preparation  of  data  forms  manually  by 
base  management. 

(  5 )  There  is  a  need  to  correlate  GPA  ("Health")  rating 
with  maintenance  actions.  For  example,  if  blade  and  vane  failures 
are  attributed  to  higher  temperatures,  the  flame  profile  and 
pattern  may  be  an  important  indicator.  The  ALC  operations  super¬ 
visor  feels  there  is  a  need  to  develop  a  statistical  data  base 
that  makes  a  valid  correlation  between  performance  trends  and 
maintenance  action. 

(6)  He  stated  his  philosophy  that  the  engine  management 
data  base  should  be  composed  of  a  front-half  and  a  back-half. 

The  front-half  is  the  local  data  at  the  base  level  in  terms 
of  hours,  LCFs,  and  some  weighted  engine  health  signature! s) . 

The  back-half  is  composed  of  summary  engine  data  for  hours  and 
cycle  information  by  engine  serial  number  and  location.  He 
stated  firmly  that  the  primary  base  level  data  displayed  should 
include  as  a  minimum: 


(a) 

engine 

S/N 

(b) 

aircraft  number 

(c) 

Julian 

date 

(d) 

base  location 

(e) 

total 

engine  hours 

(f) 

LCF  counts 

(g) 

engine 

health  signature. 

He  referred  to  personnel  at  Kelly  who  successfully  managed 
the  MAC  engine  inventory  using  these  parameters.  This  data 
once  laundered  through  the  bases  can  be  transferred  to  the  depot 
through  the  MMICS  network.  Typically,  the  engine  manager  in 
MAC  might  need  this  data  updated  every  12  hours.  However,  the 
operational  limit  seems  to  be  a  24  hour  update  cycle  (that's 
what  MMICS  is  designed  to  do). 
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(7)  He  seemed  very  concerned  that  we  obtain  realistic  !j 

requirements  from  the  engine  manager  and  chief  of  maintenance  H 

level. 

(8)  System  Requirements:  He  defined  the  following  list 
of  questions  to  be  answered  by  the  TEMS  data  base: 

(a)  What  are  the  current  values  of  the  engine  and  module 
parameters?  (see  previous  list) 

(b)  Has  the  engine  been  trimmed  recently?  How  many  times? 

(might  also  be  interested  in  how  much  trim  adjustment 

is  remaining  for  temperature,  EPR  and  speeds)  j' 

I  \k 

(c)  Has  this  engine  suffered  from  stagnation  stall?  i;1 

(d)  How  do  a,b,  and  c  relate  to  previous  engine  maintenance? 

(e)  Can  previous  engine  and  module  data  be  correlated  j' 

with  previous  parts  consumption?  (there  currently 

appears  to  be  some  correlation  between  parts  coming 
off  AMT  engines  and  parts  from  depot,  e.g.,  $  O.T. 

can  be  correlated  with  %  blade  replacement/repai r .  )  ( 

ALC  Data  Processing  Specialist 

(1)  Profile:  Since  April  1977,  the  Lieutenant  has  been 
Project  Engineer  for  the  OCM  Program  at  SA-ALC.  He  has  served 
ten  years  of  enlisted  duty  and  has  participated  in  the  Air  Force 
education  commission  program  to  earn  a  degree  in  mechanical 

engineering.  Past  assignments  include  HQ  Command  and  Communica-  i 

tions,  Bolling  AFB.  He  is  familiar  with  the  Maintenance  Data 

Collection  System  (AFTO  349).  His  present  duties  involve  user  ! 

interface  for  the  G337  engine  parts  tracking  system  for  the 
FI  00 . 

(2)  The  MMICS  software  was  designed  to  be  programmer  efficient, 

not  user  efficient.  A  four  card  format  is  required  for  the  |j 

transfer  of  information  from  base  to  CDB.  Input  edits  have  >' 

been  implemented  to  reduce  input  error  and  improve  quality  of 
MMICS  data.  781-E  Maintenance  Data  is  now  available  via  the 
MMICS  TREs  (transfer  records).  He  reports  that  the  voluminous 

TRE  printouts  are  a  cumbersome  replacement  at  SAALC  for  the  t 


old  781-E  forms.  According  to  a  Msgt  from  the  maintenance  facility 
the  manually  recorded  data  is  held  to  be  more  reliable  and  accurate 
than  the  MMICS  products. 

(3)  The  history  behind  the  location  of  the  CDB  at  OCALC 
began  with  the  MASIIS  computer  used  on  the  C-5  aircraft  program. 
When  the  IBM  360/65  was  transferred  to  the  Air  Force,  SAALC 

had  wanted  it  on  site  because  of  their  responsibility  for  C- 
5  maintenance.  Instead  the  MASIIS  was  installed  at  OCALC. 

The  original  IBM  360/65  has  been  upgraded  to  a  triplex  unit. 

SAALC ' s  IBM  1130  system  is  linked  by  a  dedicated  line  to  the 
OCALC  computer  facility. 

(4)  G337  is  the  parts  tracking  data  system  for  the  F100 
engine.  The  base  is  responsible  for  updating  G337  daily  with 
information  from  the  EHR.  Currently,  94  time/cycle  limited 
components  are  monitored.  Two  G337  products  are  used  extensively 
for  OCM  decisions.  They  are  the  3032  report  (engine  composition) 
and  the  3017  report  (life  accrual).  The  3017  form  is  used  to 
direct  opportunistic  maintenance  on  the  life  limited  components. 

It  lists  the  life  balance  in  cycles  or  hours  for  the  94  key 
components.  Because  of  cannibalization  and  failure  to  report 

the  serial  numbers  on  replaced  components,  information  in  the 
G337  is  often  incorrect.  When  an  engine  passes  through  SAALC, 
serial  numbers  on  the  disassembled  engine  are  recorded  manually 
and  compared  with  those  on  the  3032.  G337  reports  use  tabular 

listings  exclusively;  the  density  of  data  is  high. 

(5)  He  describes  OCM  as  being  a  totally  subjective  process. 
The  team  consists  of  personnel  representing  material  management 
(an  engineer  and  technician)  and  the  maintenance  facility  (scheduli 
quality  control,  production).  A  local  engine  manufacturer  represen 
tative  is  often  present.  The  current  lead  engineer  is  very 
qualified.  OCM  is  dependent  on  thorough  engine  condition/perfor¬ 
mance  information.  This  is  currently  unavailable  to  the  team 

on  a  timely  basis.  He  would  like  to  see  the  following  assembled 
in  a  comprehensive  engine  profile  for  OCM: 


(a)  removal  reason  (e.g.,  forced  or  caused) 

(b)  malfunction  occurence 

(c)  maintenance  document 

(d)  borescope  report 

(e)  FTIT  out  of  bands 

( f )  SOAP 

(g)  history  (781-E) 

(h)  test  stand  report  from  base 

(i)  history  of  over temperature  bands 

(j)  outstanding  TCTOs 

(k)  G337  products. 

(6)  The  real  impact  of  engine  monitoring  and  improved 
engine  management  at  the  depot  would  be  to  increase  the  efficiency 
of  moving  the  asset  through  the  repair  facility  (this  probably 
does  not  represent  real  cost  savings  unless  the  Air  Force  can 
support  engines  with  less  manpower).  The  performance  data  will 
remove  some  of  the  subjectivity  from  the  OCM  process.  The  big 
implementation  problem  will  be  how  to  convince  the  personnel 

to  use  the  system. 

(7)  There  are  two  scenarios  for  deployed  squadron  engine 
monitoring.  Under  the  first  there  would  be  no  terminal  at  the 
remote  location.  TEMS  data  would  be  flown  back  to  the  home 
base  weekly.  In  the  second  scenario,  the  squadron  would  have 
a  mini  computer  with  a  local  data  base. 

2.3  HEADQUARTERS  AFLC 


Discussion  Anal> 


(1)  Information  currently  available  for  engine  management 
is  not  easily  accessible  in  a  format  optimized  for  use  in  the 
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maintenance  process.  Previous  Air  Force  engine  data  systems 
have  been  tailored  to  the  requirements  of  logistics  management. 
Because  of  the  different  functions  of  engine  maintenance  and 
logistics  management,  current  data  systems  do  not  specifically 
address  the  informational  needs  of  the  maintenance  managers. 

A  key  objective  of  the  orientation  visits  is  to  isolate  the 
particular  engine  data  and  information  required  for  fault  isolation 
and  maintenance  specification  at  the  base  and  depot  levels. 

(2)  The  outputs  of  engine  monitoring  and  trending  must 
be  correlated  to  engine  maintenance  concepts.  Experience  with 
currently  implemented  engine  monitoring  systems  described  by 
cognizant  Air  Force  personnel  supports  this  hypothesis. 

(3)  Implementation  of  turbine  engine  monitoring  will  impact 
base  operations.  The  implementat ional  aspect  is  the  most  critical 
element  in  the  specification  of  requirements  for  an  engine  monitor¬ 
ing  system.  It  is  essential  to  factor  in  the  potential  impacts 
and  identify  any  problems  that  may  occur. 

2.3.2  PERSONAL  INTERVIEW 

TEMS  Program  Manager 

Comments  concerning  the  future  of  performance  monitoring 
in  the  Air  Force  and  the  potential  impact  on  the  logistics  and 
support  of  engines  were  solicited  from  a  TEMS  program  manager. 

(1)  Profile:  As  a  Captain  in  the  Air  Force,  he  flew  F-4's. 

He  was  a  member  of  the  F - 1 5  site  acquisition  team  at  Luke  AFB. 
During  a  two  year  assignment  to  the  Air  Force  Aero  Propulsion 
Laboratory,  he  was  engine  propulsion  analyst  for  the  F100. 

He  also  served  as  F100  EDS  Program  Manager  and  supported  the 
F100  engine  at  the  F15  SPO.  Currently  assigned  to  AFLC  he  is 
director  of  On-Condition  Maintenance.  He  is  involved  with  the 
development  of  policy  and  procedures  for  the  A-10  and  J-85  TEMS. 

He  also  is  the  AFLC  coordinator  for  the  F100  EDS  Program. 


(2)  The  A-10  system  is  the  first  attempt  by  the  Air  Force 
to  implement  a  TEMS  that  functions  in  an  operating  environment. 

(3)  The  single  biggest  failure  of  MADARS  is  the  innundation 
of  data.  TEMS  should  be  equipped  for  continuous  monitoring 

but  not  continuous  recording.  In  his  opinion  the  recommendation 
to  equip  all  TEMS  with  continuous  recording  capabilities  is 
unsound.  He  feels  that  the  continuous  recording  option  should 
be  reserved  for  only  a  small  portion  of  the  fleet  and  used  at 
the  AFLC  level  to  identify  needed  improvements  in  engine  design. 

(4)  The  DDU  concept  is  not  unique  to  TEMS.  The  uniqueness 
is  the  information  itself  and  the  ability  of  the  receiving  data 
system  to  handle  the  flow  of  information. 

(5)  Acceptance  of  the  CRT  displays  does  not  appear  to 
be  an  insurmountable  problem.  Base  and  depot  level  personnel 

are  familiar  with  tabular  hardcopy  information  and  are  not  currently 

aware  of  the  options  available  with  graphical  displays.  It 

will  be  important  to  educate  them  to  the  potential  display  options. 

(6)  He  believes  that  a  comprehensive  management  capability 
will  ultimately  improve  the  communication  problems  between  the 
base  and  the  depot.  It  will  provide  ALC ,  MAJCOM  and  Base  Engine 
Managers  with  a  common  data  base. 

(7)  It  is  conceivable  that  the  Air  Force  may  decide  to 
abandon  the  current  hardware  for  MMICS.  This  decision  will 
be  influenced  in  part  by  the  software  required  to  handle  and 
process  the  engine  performance  data.  He  mentioned  that  it  will 
be  important  to  specify  a  backup  mode  for  TEMS  in  the  event 
that  MMICS  is  down. 

(8)  He  feels  that  with  automated  engine  monitoring  the 
Air  Force  will  be  able  to  do  a  better  job  of  engine  management 
with  fewer  people.  The  major  impact  at  the  base  level  will 

be  a  overall  increase  in  the  understanding  of  engine  operations 
and  support.  At  the  depot  level  engine  monitoring  data  will 
impact  the  practice  of  OCM.  Depot  and  base  level  managers  will 


be  working  from  a  common  data  base,  AFLC  and  the  major  commands 
will  have  more  visibility  into  the  engine  management  situation. 

They  will  have  a  better  basis  from  which  to  perform  surge  analysis, 
predict  global  engine  removal  rates  and  workloads,  and  improve 
supply  posture.  Information  from  propulsion  monitoring  will 
also  be  helpful  in  the  development  of  software  to  specify  policy 
and  procedures  for  opportunistic  maintenance  and  optimal  engine 
build. 


(9)  The  time  criticality  of  information  required  at  the  j 

base  level  will  be  a  prime  driver  in  the  specification  of  the  !1 

system  requirements.  || 

(10)  The  engine  manufacturer  is  performing  the  F100  Reliability  [: 

Centered  Maintenances  (RCM)  Analysis.  They  will  be  responsible  j.J 

for  establishing  hard  time  and  fly  to  failure  components,  for  '] 

setting  inspection  intervals  and  developing  OCM  procedures  for  , 

the  F100.  He  envisions  that  the  performance  data  will  potentially  i, 

be  used  to  feedback  and  update  RCM  standards  set  on  the  F100. 

(11)  In  response  to  the  question  of  system  acceptance, 
he  answered  that  he  felt  the  field  people  (base  level)  were 

in  dire  need  of  help  and  for  this  reason  they  should  be  willing 
to  use  an  automated  system.  The  key  will  be  to  make  it  clear 
that  the  system  will  assist  them  in  their  daily  work  and  provide 
useful  information  for  workload  scheduling  and  decision  making. 

If  we  can  get  this  concept  across  and  if  the  displays  we  design 

i 

are  meaningful,  then  the  system  should  sell  itself. 

(12)  In  general,  the  response  requirements  for  data  base  : 

updating  is  24  hours  at  the  base  level.  For  longer  term  data 

(historic),  at  least  one  base  level  computer  (CRT)  should  be  jj 

able  to  interface  with  the  MMICS  computer. 

(13)  A  general  software  design  consideration  should  be 
the  number  of  engines  for  which  each  engine  manager  is  currently 
responsible.  He  commented  that  where  the  airlines  have  a  ratio 
of  1  engine  manager  for  every  200  engines,  the  Air  Force  currently 
has  a  ratio  of  1/3000  engines.  The  summary  engine  health  and  | 
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trending  data  should,  therefore,  be  organized  in  a  format  suitable 
for  simplifying  the  engine  manager's  workload  and  decision  making. 


2.4  MAJOR  COMMANDS  (MAJCOM) 

2.4.1  Personal  Interviews  (HQTAC) 

HQTAC  TEMS  Liaison 

(1)  Profile:  During  the  lengthy  career  of  this  SMSgt , 
he  followed  the  development  of  Northrop  EHMS  hardware  from  the 
initial  test  on  the  T38/J85  by  the  Air  Training  Command  (ATC) 
at  Randolph  AFB.  He  has  been  instrumental  in  the  application 
of  the  systems  hardware  on  the  A-10/TF34  at  Myrtle  Beach  and 
the  development  of  the  service  evaluation  plan.  This  knowledge 
coupled  with  his  expertise  in  engine  maintenance  management 

at  the  base,  depot,  and  command  levels  made  him  a  key  source 
of  input  for  the  systems  analysis. 

(2)  An  extended  interview  was  held  to  brief  him  on  the 
program,  discuss  his  survey  response,  and  elicit  his  comments 
on  additional  scenarios  and  displays.  His  personal  experience 
with  the  TEMS  hardware  was  discussed  and  implementat i onal  aspects 
of  a  generic  system  within  the  Air  Force  maintenance/logi st i cs 
framework . 

(3)  Comments  on  survey  and  maintenance  information  systems: 

In  both  his  written  responses  and  the  subsequent  discussions, 

he  strongly  emphasized  the  need  to  correlate  maintenance  history 
with  performance  trends.  In  the  survey  displays  only  summary 
indicators  of  certain  maintenance  actions  were  provided  with 
the  trends.  He  indicated  that  this  was  inadequate.  In  order 
to  understand  the  cause  and  effect  behind  these  trends  it  would 
be  necessary  for  shop  maintenance  personnel  to  have  specific 
information  on  the  procedures,  and  component  replacement/repai r 
that  occurred  during  any  maintenance  action.  This  information 
is  presently  collected  manually  and  available  for  MMICS.  A 
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mechanism  must  be  established  for  cross-referencing  relevant 
history  with  an  appropriate  interval  of  trended  GPA  performance 
data  (e.g.,  last  100  operating  hours)  and  providing  the  information 
to  the  user  on  a  single  display.  One  caveat  that  he  placed 
on  the  available  historical  data  was  the  issue  of  accuracy. 

He  indicated  that  inaccuracy  was  induced  from  two  sources: 

errors  in  actual  recording  of  the  data,  and  abbreviated  descriptions 

of  maintenance  actions  resulting  in  omission  of  important  details. 

He  identified  the  requirements  for  enhanced  diagnostic 
information  on  the  engine  profile.  He  felt  that  the  diagnostic 
message  on  the  sample  displays  was  only  marginally  adequate. 
Suggested  enhancements  included  peformance  information  related 
to  the  specific  flagged  event  and  a  synopsis  of  the  probable 
causes  for  the  fault. 

In  general,  he  preferred  the  displays  with  denser  information 
content.  He  indicated  a  number  of  additions  and  deletions  that 
were  consistent  with  the  survey  response  (e.g.,  deletion  of 
the  spares  rate  from  the  base  status  summary,  additional  informa¬ 
tion  on  repair  status  of  uninstalled  engines,  etc.).  He  had 
certain  reservations  with  respect  to  management  by  exception, 
particularly  as  it  related  to  data  on  the  engine  profile.  He 
indicated  that  when  an  event  triggered  a  highlighted  message 

in  the  vibration  or  SOAP  categories  he  would  like  to  see  the 

associated  level  (e.g.  G/B  a. 9  mils)  before  accessing  a  subsystem 
summary . 

He  prefaced  his  comments  on  the  maintenance  forecasting 
scenario  by  saying  that  performance  trending  and  accurate  prognos¬ 
tication  are  key  to  the  application  of  true  OCM.  He  pointed 

out  that  the  use  of  the  word  "failure"  on  some  of  the  displays 

had  a  bad  connotation  within  the  Air  Force  interpretation  of 
OCM.  "Failure"  implies  the  principle  of  fly- to- fa i lure ,  which 
is  the  very  practice  the  Air  Force  is  attempting  to  avoid  via 
performance  trending  and  OCM. 
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In  addition  to  the  monthly  displays  of  time/cycle  and  perfor¬ 
mance  removals,  he  identified  the  need  to  establish  a  watch 
status  report.  Its  purpose  would  be  to  flag  engines  that  exhibit 
step  changes  in  SOAP  or  vibration  or  significant  trends  in  degraded 
performance  of  net  or  module  GPA.  This  display  would  identify 
those  engines  whose  health  should  be  currently  monitored  on 
a  regular  basis  (e.g.  every  other  day,  weekly).  The  watch  status 
report  would  enhance  the  manager's  capability  to  anticipate 
near-term  maintenance  on  an  individual  engine  basis.  The  benefits 
of  such  a  capability  would  be  twofold: 

•  identification  of  incipient  failures  and  projection 
of  required  repairs  and  replacements; 

•  extraction  of  the  maximum  life  from  an  engine,  module, 
or  component  without  operating  the  asset  to  the  point 
of  failure  or  severe  degradation. 

Besides  citing  the  engine  serial  number,  installed  aircraft 
tail  number,  and  watch  status  reason,  the  report  should  include 
other  engine  usage  factors  (e.g.,  time/cvcles,  HST  I  / 1 1 )  that 
might  be  instrumental  in  potential  specification  of  a  maintenance 
action.  These  factors  would  be  a  subset  of  the  information 
normally  available  from  a  sort  request.  (In  effect  the  watch 
status  report  is  an  automatic  sort  on  all  installed  engines 
whose  status  has  been  designated  as  watch . ) 

The  watch  status  report  allows  base  level  shop  management 
to  make  more  effective  use  of  their  time.  By  creating  an  engine 
status  that  falls  between  full  mission  capability  and  alarm 
condition  (critical),  the  manager  is  alerted  of  a  significant 
but  non-critical  shift  in  a  monitored  performance  or  usage  factor. 
The  watch  status  display  identifies  those  engine  profiles  and 
relevant  subsystem  summaries  that  currently  require  careful 
monitoring  and  regular  access  by  the  manager.  This  supports 
the  management  by  exception  concept,  i.e.  selective  identification 
and  access  of  engine  profiles. 


In  terms  of  deployent  scenarios,  he  identified  that  engine 
health/condition  is  only  one  element  of  the  selection  process. 
Generally,  mobility  planning  identifies  a  group  (e.g.,  squadron) 
of  aircraft  that  are  FMC  and  properly  configured  for  the  deployment 
scenario.  At  that  point  the  wing  chief  of  propulsion  would 
be  asked  to  assess  the  engine  health  and  recommend  the  aircraft 
to  support  the  deployment  requirements.  Under  these  procedures 
a  joint  GPA  ranking  would  be  applicable  only  after  sorting  the 
engine  files  based  on  the  eligible  aircraft.  For  a  multiple 
base  deployment,  HQTAC  generally  tasks  each  base  to  provide 
a  certain  number  and  type  of  aircraft  and  spare  engines.  The 
interactive  deployment  planner  would  probably  be  more  applicable 
at  the  base  level. 

HQTAC  Maintenance  Officer 


(1)  Profile:  This  USAF  Captain  served  as  a  maintenance 
officer  for  a  Fill  wing  under  a  POMO.  He  was  recently  assigned 
to  the  engine  monitoring  group  at  HQTAC,  Langley  AFB.  He  will 
be  following  the  A-10  TEMS  program  at  Myrtle  Beach. 

(2)  EHMS/TEMS  appears  to  cause  maintenance.  In  the  Air 
Training  Command  (ATC)  demonstration  at  Randolph  AFB,  TEMS  "cost” 
more  manpower  at  the  base  level.  The  problem  with  the  ATC  experi 
ment  was  that  there  was  really  no  control  placed  on  the  "control" 
group.  ATC  operates  a  reliable,  mature  engine.  The  mainten¬ 
ance  personnel  were  experienced.  ATC  characteristically  has 
less  manpower  turnovers  than  any  other  command.  Engine  problems 
flagged  by  the  TEMS  were  identified  by  the  skilled  maintenance 
staff.  The  report  that  resulted  from  the  ATC  TEMS  experiment 
was  not  supportive  of  engine  monitoring.  Recent  documents  from 
ATC  reveal  that  the  command  has  altered  its  position  and  has 
taken  a  "pro-diagnostics"  stance.  The  TAC  mission  is  conducive 
to  monitoring  because  the  mission  impacts  engine  health.  During 
the  Holloman  TEMS  tests,  pilots  reported  discrepancies  often 
occurred  when  the  aircraft  was  being  operated  outside  the  estab¬ 
lished  profile.  TEMS  data  was  used  to  verify  this. 
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(3)  He  compared  the  implementation  of  SOAP  to  engine  monitor¬ 
ing  When  SOAP  was  first  introduced  as  a  maintenance  tool  at 
the  base  level,  there  was  wide-spread  skepticism.  Today,  SOAP 
has  become  an  accepted  indication  of  engine  health.  Performance 
monitoring  should  offer  the  same  sort  of  benefits  if  properly 
implemented.  He  feels  that  automated  monitoring  may  very  well 
be  the  SOAP  of  tomorrow. 

2.4.2  Personal  Interview  (SAC) 

Former  SAC  Engine  Manager 

(1)  Profile:  As  a  USAF  Captain,  he  served  as  a  maintenance 
officer  in  SAC.  He  has  experience  working  in  both  the  supply 
and  maintenance  organization  at  the  base  level.  He  also  served 
as  a  SAC  squadron  commander.  His  next  assignment  was  as  SAC 
Engine  Manager.  The  bases  in  his  command  operated  TF33,  TF30, 

J85,  and  J57  engines.  As  SAC  EM  he  was  responsible  for  calculating 
stockage  objectives  for  spare  engines  and  monitoring  base  supply 
status  over  the  year.  He  served  on  the  Aerospace  Engine  Life 
Committee/Engine  Logistics  Planning  Board  and  participated  in 

the  twice  yearly  formulation  of  actuarial  factors.  He  joined 
HQAFLC  in  July  1978  after  retiring  from  the  Air  Force.  He  is 
currently  involved  with  AFLC's  program  on  the  enhancement  of 
the  pipeline  and  actuarial  sytems  (CEMS  Increment  III). 

(2)  A  typical  SAC  operating  scenario  is  flying  out  on 
an  exercise  and  landing  at  an  intermediate  location  for  fuel 
and  returning  to  the  home  base.  Under  the  peace-time  operating 
scenario,  1/3  of  the  engines  are  on  alert,  1/3  are  assigned 

for  training,  and  1/3  are  in  maintenance.  The  SAC  EM  tracks 
the  location  and  operational  status  of  all  engines  assigned 
to  his  command. 

(3)  The  issue  of  war  surge  analysis  is  of  critical  concern 
to  the  MAJCOM  EM.  Under  war  conditions  engine  flying  hours 
increase  by  two  to  five  times  the  peace-time  rate.  How  does 


this  affect  engine  failures?  Are  current  spares  to  installed 
ratios  adequate  under  this  scenario  (e.g.,  181  J57,  12-141  for 
TF39  and  TF33)?  Can  the  pipeline  handle  increasing  failure 
rates  and  decrease  turnaround  time  on  engines?  He  used  a  Fleet 
Management  Information  System  (FMIS)  that  he  developed  at  SAC 
to  monitor  base/engine  asset  posture. 

(4)  He  is  familiar  with  the  SAC  engine  condition  monitoring 
program  from  the  management  side.  He  thinks  that  the  most  success¬ 
ful  aspect  of  the  program  was  that  base  personnel  were  tracking 
engine  performance  while  they  were  operating.  A  major  problem 
for  SAC  is  to  decide  in  what  direction  the  condition  monitoring 
program  should  go  now.  He  suggested  that  SAC  might  use  the 
data  to  carefully  examine  the  impact  of  operating  time  on  an 
engine . 

The  user  requirements  at  the  lower  level  (base)  will  drive 
the  requirements  for  information  at  the  higher  levels  (depot, 
MAJCOM).  A  time  slice  report  would  be  of  real  value  to  the 
base  level  engine  manager.  The  overall  Air  Force  engine  management 
objective  is  to  maintain  a  creditable  readiness  posture  with 
an  ever  tightening  budget. 

(6)  Automated  monitoring  will  not  go  on  older  engines. 

It  will  fly  on  newer  models  particularly  fighters.  The  most 
important  impact  is  that  it  will  improve  the  manager's  ability 
to  schedule  workloads  for  maintenance  and  supply  activities. 

(7)  Training  and  skill  level  problems  may  become  implementa¬ 
tion  obstacles.  Within  SAC  there  is  generally  good  job  longevity 
at  the  base  level.  Acceptance  of  the  CRT  display  will  take 

some  training.  It  will  be  necessary  to  have  a  central  system 
to  share  the  overhead  (e.g.,  cost,  management)  of  automated 
management  system. 

(8)  He  pointed  out  that  OCM  is  not  an  entirely  new  concept. 
Certain  aspects  of  OCM  have  been  practiced  within  the  overhaul 
process.  The  new  approach  is  however  more  structured  and  requires 
more  information. 
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(9)  Important  MAJCOM  engine  manager  requirements  at  SAC 
include : 

(a)  Calculating  and  comparing  engine  spares/installed 
ratios  on  a  yearly  basis  for  various  aircraft. 

(b)  Monitoring  and  adjusting  spares/installed  as  required 
to  meet  operational  readiness  criteria. 

(c)  Holding  up  engine  assets. 

(d)  Supporting  Logistics  Planning  Board  Activities. 

(e)  Examining  actuarial  factor  changes  (twice  yearly). 

(f)  Answering  day-to-day  questions. 

(10)  Questions  typically  asked  at  the  SAC  level  are  related 

to  longer  term  time  related  engine  and  aircraft  management  decisions. 
For  example,  how  many  aircraft  (engines)  of  a  given  type  are 
currently  available  (or  being  used  for)  military  exercises?, 
deployment?,  and/or  remote  operations  support?.  Technical  engine 
related  (OCM)  problems  have  to  be  dealt  with  on  both  a  supply 
and  cost  basis  as  well  as  scheduling.  For  example,  suppose 
the  TF30  outer  combustor  cases  are  consistently  breaking.  The 
SAC  responsibility  falls  in  the  areas  of  predicting  the  catch¬ 
up  time  reHuired  to  find  and  retrofit  all  operational  engines. 

Also,  procedures  must  be  developed  for  maintaining  tighter  inven¬ 
tory  control  on  these  "weak  links"  in  order  to  keep  the  spares/ 
installed  ratios  reasonable. 

(11)  System  Requirements  --  The  following  TEMS  "wish  list" 
was  developed  through  these  discussions: 

(1)  Engine  status  summaries  at  the  base  and  depot  level 
should  be  displayed.  Serial  numbers  and  location 
at  the  very  least. 

(2)  Historic  and  current  asset  posture  trending  capability 
vs.  calendar  years  is  a  primary  evaluation  tool  during 
budget  cuts. 

(3)  Number  of  engines  required  per  flying  hour  is  another 
supply  parameter. 
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(4)  Displaying  number  of  spared  or  spares/installed  ratio 
at  the  module  level  in  a  "Pie  Chart"  format  would 

be  extremely  useful.  This  would  show  at  a  glance 
what  percent  of  dollars  time,  etc.,  were  being  expended 
on  fans,  combustors,  afterburners,  etc. 

(5)  Removals/month  is  also  a  vital  parameter  on  a  per 
base  level. 

(6)  Throughput  days  at  JEIM  is  also  tracked  by  engine 
type. 

(7)  The  critical  need  for  a  comprehensive  management  system 
is  to  achieve  commonality  in  usage  parameters  (data), 
codings,  and  communications  between  the  base,  the 
depot  and  the  MAJCOM.  The  depot  and  the  supply  personne 
must  use  the  same  working  data  or  the  system  will 

not  be  effective. 

(8)  A  critical  requirement  at  the  base  level  is  to  develop 
a  better  parameter  or  technique  for  predicting  required 
engine  maintenance  and  therefore  maintenance  workload. 
Currently,  time  (flying  hours)  is  used  but  is  not 

an  accurate  indicator.  In  general,  75-80%  of  current 
engine  removals  are  premature,  that  is,  non-max  time. 

2.4.3  Personal  Interview  (ADC)  Engine  Manager 


The  ADC  mission  is  continental  defense  under  the  Chief 
of  Staff  of  the  Air  Force.  Base  of  operations  is  therefore 
CONUS  and  alert  detachments  are  deployed  across  the  country. 

ADC  is  actually  a  tenant  on  each  base.  Engine  histories  were 
kept  manually  and  data  management  was  primarily  via  telephone 
lines. 

(1)  Profile:  He  served  at  the  depot  as  engine  manager 
for  the  TF33  and  TF41  engines.  His  next  assignment  was  at  the 
Air  Defense  Command  in  the  Directorate  of  Maintenance  as  an 
engine  manager.  He  has  experience  there  with  the  J75,  J57, 
and  J3^  engines.  He  joined  AFLC  in  June  1978. 

(2)  The  primary  mission  of  ADC  is  CONUS  defense.  ADC 

is  a  small  command  (6  bases,  1  training  base).  ADC  is  a  tenant 
on  all  but  two  of  its  bases.  There  are  19  UE  (Unit  Equipment- 
svngle  engine  aircraft)  assigned  to  the  operating  bases  and 
24' at  the  training  base. 
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(3)  ADC  deploys  alert  detachments  for  cross-country  missions. 
An  important  responsibility  of  the  engine  manager  is  to  assure 
that  his  alert  aircraft  are  supported.  Because  alert  detachments 
operated  under  a  "no-maintenance  concept"  the  rule  of  thumb 

was  to  have  one  operationally  ready  engine  available  for  each 
aircraft  on  alert  status. 

(4)  ADC  base  level  maintenance  used  pilot  squawks  (e.g., 
stalls,  vibration),  SOAP,  EPR ,  EGT,  hot  starts,  and  crew  squawks 
to  identify  and  direct  maintenance  actions.  Trim  problems  are 
more  critical  on  a  single  engine  aircraft.  A  notebook  containing 
maintenance/performance  history  on  each  engine  was  kept  in  the 
engine  shop.  Operating  time  was  recorded  on  chalk  boards  also 
located  in  the  shop.  Engines  for  installation  were  chosen  commen¬ 
surate  with  aircraft  time.  Engines  (except  for  MOT)  were  NRTS 
only  after  the  evaluation  of  the  maintenance  technicians  and 

the  approval  of  the  command. 

(5)  As  ADC  Engine  Manager,  he  tracked  spares  availability, 
condition  of  engines  in  work  and  the  number  of  ENORS  (now  ENMCS). 
Component  problems  were  cyclic  in  nature  and  required  tracking 

of  critical  parts.  Because  of  the  small  size  of  ADC  he  maintained 
daily  contact  with  the  bases  via  phone. 

(6)  He  thinks  that  the  primary  impact  of  TEMS  will  be 

the  accuracy  of  documentation  and  the  timeliness  of  information. 

He  thought  there  would  be  little  resistance  to  CRT  displays 
at  the  base  level.  In  ADC  there  is  good  job  longevity  for  person¬ 
nel  at  the  base  level. 

(7)  He  was  able  to  achieve  a  less  than  201  NORS  rate  over 
a  two  year  period.  ADC  essentially  tracked  and  managed  engines 
by  reliability  techniques.  Every  3-4  weeks  an  engine  status 
would  be  prepared  which  included: 

•  Spares  available 

•  Condition  and  status  of  engine  in-work  (base  and  depot) 

•  NORS  rate 

•  Days  remaining  before  NORS  impact. 


(8)  He  described  the  major  role  of  an  automated  monitoring 
as  keeping  engine  time  in  sync  with  aircraft  time  for  single 
engined  aircraft.  Critical  maintenance  and  long  lead  time  parts 
such  as  A/B  welds  and  manifold  fixes,  can  be  done  opportunistically, 
but  were  driven  by  parts  supply,  pipeline  and  work  scheduling 
criteria. 

He  felt  that  a  remote  CRT  would  have  been  "handy"  for  TCTO 
work,  etc.,  but  that  he  could  have  done  his  job  effectively 
without  it  if  given  a  few  more  telephone  lines. 

His  opinion  of  the  major  impact  of  an  automated  TEMS  would 
be  on: 

(a)  Documentation  at  the  shop  level  (re:  checklist) 

(b)  Maintenance  history  logs 

(c)  Summary  MOT  data  for  the  shop  chief 

(d)  Serialized  control  of  parts. 

In  regard  to  (d),  he  said  that  he  experienced  a  cyclic 
occurrence  of  maintenance  problems  on  particular  engines.  That 
is,  something  you  thought  was  changed  would  either  not  be  modified 
on  a  particular  S/N  engines  or  the  fix  would  prove  inadequate. 

In  general,  he  felt  that  the  MMICS  concept  was  viable  and 
would  be  accepted  at  the  base  level  as  preferable  to  manual 
"paper  shuffling",  e.g.,  AFM66-1  forms. 
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APPENDIX  B 

SURVEY  DESIGN  AND  ANALYSIS 


I.  SURVEY  DEVELOPMENT 

The  information  system  for  automated  engine  monitoring  will 
have  hierarchical  design.  Access  to  data  is  controlled  by  certain 
key  functions.  SCI  (Vt)  developed  the  TEFDI  survey  around  index, 
profile,  alarm,  and  forecasting  functions. 

There  are  three  index  functions,  viz.,  finding,  ranking,  and 
grouping.  Finding  refers  to  accessing  engine  files  according  to 
a  particular  attribute  (e.g.,  serial  number,  operational  status, 
location,  operating  hours  above  or  below  a  specified  limit,  etc.), 
binding  displays  list  all  engines  possessing  the  user  specified 
attribute.  Ranking  refers  to  ordering  engine  files  according  to 
numerical  attribute  (e.g.  GPA  rating,  operating  hours,  LCF  counts). 
The  ranking  displays  list  the  engines  with  the  desired  attribute 
and  in  the  order  requested  by  the  user.  One  objective  of  the 
survey  is  tc  determine  which  elements  of  the  individual  engine 
file  are  neeaed  to  make  the  management  decisions  that  require  sorted 
and  ranked  data.  The  grouping  function  refers  to  the  tabulation 
of  engines  possessing  certain  attributes  (e.g.,  number  of  installed 
FlOO's,  number  of  engines  awaiting  maintenance).  Examples  of 
grouped  displays  include  summary  of  the  operational  status  of  all 
engines  at  a  particular  base  or  the  status  of  all  bases  within  a 
certain  command. 

Access  of  individual  engine  files  by  serial  number  is  called 
the  profile  function.  The  profile  summary  contains  the  engine's 
vital  statistics.  Add  it iona 1  in  format  ion  i  s  obtained  by  requesting 
various  subsystem  functions  (e.g.,  GPA  trends,  vibration  history, 
SOAP  charts,  engine  build,  etc.).  The  profile  summary  contains 
the  quantity  of  information  normally  needed  to  manage  the  engine. 
Subsystem  displays  are  accessed  by  the  user  on  an  exception  basis. 
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The  survey  scenarios  were  directed  towards  determining  the 
information  to  include  in  the  profile  summary  and  the  types  and 
formats  of  information  to  offer  in  the  subsystem  displays. 

Engine  monitoring  systems  provide  the  capability  for  an 
alarm  function  at  the  base  level.  The  alarm  is  the  identification 
of  a  detected  fault  on  a  specific  engine.  The  engine  manager  then 
accesses  the  profile  summary  and  relevant  subsystem  displays  for 
that  engine. 

A  forecasting  function  has  been  identified  as  a  possible  re¬ 
quirement  for  engine  logistic  support.  A  number  of  the  survey 
scenarios  that  relate  to  depot  and  MAJCOM  level  decisions  contain 
an  element  of  forecasting.  Survey  questions  were  formulated  to 
identify  specific  requirements  for  the  forecasting  function  in  the 
system  specification. 

The  key  functions  that  control  data  access  are  index,  profile, 
alarm,  and  forecasting.  Table  1  cross-references  each  of  the  eleven 
decision  scenarios  with  the  functional  modes  that  were  demonstrated 
in  the  display  systems.  The  three  index  functions  are  grouping, 
ranking,  and  finding.  The  grouping  function  appears  with  five 
scenarios  (QA,  QC ,  QE,  QJ ,  QK) ,  the  ranked  with  two  (QA,  QI),  and 
the  find  with  six  (QA,  QD,  QE,  QI,  QJ ,  QK) .  The  engine  profile 
appears  with  three  scenarios  (QB,  QC,  QG)  ;  several  examples  of 
subsystem  summary  displays  accompany  two  of  the  profiles  (QB,  QG) . 
The  alarm  function  is  illustrated  with  one  scenario  (QC) .  The  fore¬ 
cast  function  is  demonstrated  in  three  scenarios  (QF,  QH,  QJ ) .  The 
utilization  of  this  particular  combination  of  data  access  functions 
supports  the  hierarchical  design  of  the  required  management  infor¬ 
mation  system.  Table  1  also  identifies  the  relevant  management 
level  to  which  each  of  the  scenarios  were  directed.  Six  of  the 
scenarios  concentrate  on  base  level  operations.  Two  focus  on  depot 
specific  procedures.  Three  scenarios  address  command  level  manage¬ 
ment  decisions.  The  concentration  on  base  specific  scenarios  is 
due  to  the  fact  the  requirements  of  the  base  level  users  will  drive 
the  system  requ irement s  for  turbine  engine  monitoring. 


Table  1 

Scenario  Summary  Cross-Reference 


SCENARIO 

LEVEL 

0A-3ar*  3ase 
Deployment 

Base 

MODE 


index -Group; 
Index-Rank; 
Index- FIND 


i 

38-?’ lot 

Sduawk 

Base 

Profile; 

Subsystem  Summary 

TaOul ar 
Sraonicai 

TEMS; 

Base  Processor; 

MMICS  Inter-ace 

OC-Engine 

Alarm 

Base 

Index-Grouo; 

Alarm; 

Profile 

'abular 

"MS; 

3ase  Processor; 

MMICS  Interface 

DD-TC7C 

Management 

Base 

Index-  PINO 

TaDular 

Graonical 

TEMS; 

3ase  Processor; 

MMICS  interface 

DE-Sauadron 

SPA  Degradation 

3ase 

index-FIND; 

Index-Group 

"aoular 

Graphical 

TEMS ; 

3ase  Processor; 

MMICS  Interface 

Of -Base  Ha. i  n- 
:enance  rorecas: 

Base 

forecast 

'aoular; 

Srannical 

TEMS; 

3ase  Processor; 

MMICS  Interface 

Profile;  T*oular; 

Suosystem  Suimia  ry  Graomcal 


"ransfer  st  Engine 
Records  to  CDB; 

CDB  Access 


COB  Access, 
Interactive 
Cacao; 1 • t  y 


Ccmmand 

Inaex-  find 

’aoui ar 

COB  Access, 

Inoex-Ranx 

MAJCOM  Processor; 
Interactive  Cata- 

cinty  ! 

1 

I 

.ommanc 

Inoex-FINO  . 

’aD-j’ia  r; 

CCS  Access.  j 

Assessment 

Index-Grouo; 

Forecast 

Srapn; ca  ■ 

MAJCCM  p-ocessor  | 

> 

»  l^-ioar*  | 

‘Ofimand  | 

Index-Grcuc ;  1 

"aouia-  1 

COB  Access, 

[  Incite  States 

Index-  FIND 

"AJCCM 

The  formats  used  to  design  the  displays  for  the  scenarios 
are  also  specified  in  Table  1.  Each  scenario  has  at  least  one 
tabular  display  system  (AF  personnel  are  most  familiar  with 
tabular  listing  of  data).  Bargraphs  and  plotted  or  trended  data 
are  examples  of  graphical  formats.  In  six  of  the  display  systems, 
survey  participants  evaluated  graphical  alternatives. 

Processor  requirements  indicate  the  hardware  and  data  flow 
necessary  to  support  the  display  systems  for  each  scenario.  A 
basic  assumption  in  the  information  system  design  is  the  existence 
of  a  generic  monitoring  system.  The  base  must  also  possess  the 
capability  to  reduce  and  process  the  TEMS  data.  Integration  of  the 
per formance/GPA  information  with  additional  usage  factors  (e.g., 
tine,  cycles,  SOAP,  etc.)  requires  an  interface  with  the  MM ICS 
computer.  Depot  and  command  level  engine  maintenance  management 
require  the  automatic  transfer  of  engine  records  from  the  hast  to 
the  central  data  bank  (CDR) .  The  MAJCOM's  would  access  portions  of 
this  information  for  analysis  via  their  own  computer. 

11.  SURVEY  DISTRIBUTION  AND  PARTICIPANT  SELECTION 

The  survev  was  modular  and  composed  of  eleven  self-contained 
sections.  Participants  received  a  subset  of  the  eleven  sections. 

The  determination  of  each  subset  was  based  on  the  participant's 
knowledge  and  relevant  operational  experience  in  engine  maintenance  - 
logistic  management. 

The  survey  participants  were  selected  via  personal  contact 
during  on-site  visits  to  SAALC,  OCALC,  AEI.C,  MQTAC,  Langley  A!  R 
and  Myrtle  Beach  AFB.  The  individuals  are  a  representative  sample 
of  base,  depot,  and  command  engine  management.  Table  1  contains 
list  of  the  Air  Force  participant  experience  and  question  distri'nit. 
Relevant  operational  experience  in  engine  ma  int enance/ 1 og i s t ic s 
management  (i.e.  base,  depot,  command)  is  specified  for  each  in.ii 
vidiial.  The  entries  in  Table  2  indicate  the  subset  of  scenarios  tin 
were  sent  each  participant.  The  selection  of  the  appropriate 
scenarios  was  based  on  several  underlying  objectives  and  critical 
constraints. 
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Table  2 

Survey  Question  Distribution  by  Participant  Experience 


- •  1  Consistency  with  Participant's  Knowledge  and  1 xper i ence 

All  participants  were  identified  to  have  a  working  knowledge 
of  base  level  operations  from  either  the  view  of  maintenance  manage¬ 
ment  or  logistics  support  (e.g.,  supply,  planning  and  scheduling,  parts 
tracking,  MMICS) .  Participants  with  a  more  extensive  background  in  the 
in  the  logistical  aspects  of  engine  operations  were  given  base  level 
scenarios  in  forecasting  (QF)  ,  TCTO  management  (QD)  ,  and  deployment 
planning  (QA)  .  Individuals  familiar  with  the  higher  level  aspects 
of  maintenace  management  were  given  the  sections  that  corresponded 
closely  to  their  specific  experience  (e.g.  QA-Bare  Base  Deployment, 

QE  -  Squadron  Performance  Degradation,  QF  -  Maintenance  Forecast).  All 
Air  Force  participants  received  scenarios  QB  and/or  QC  because  these 
sections  investigated  the  diagnostics/engine  alarm  capability  and  the 
concept  of  performance  trending  via  the  gas  path  average. 

In  the  course  of  the  on-site  interviews,  several  people  recom¬ 
mended  inclusion  of  airmen  level  responses  in  the  analysis.  For  this 
reason,  engine  shop  representatives  at  the  1TFW  and  354  TFW  were  sent 
additional  surveys  for  distribution  to  selected  airmen  in  their  pro¬ 
pulsion  branch.  The  special  airmen  surveys  were  limited  to  the  base 
level  scenarios  that  were  directly  maintenance  oriented  (QB  <md  QC) . 

Thirty -two  of  the  survey  participants  (68%)  were  identified  as 
also  having  experience  at  the  depot  and/or  command  levels  of  engine 
maintenance/ logistics  management.  In  addition  to  the  base  oriented 
survey  sections,  they  received  selected  scenarios  from  QG  through  QK . 

2 . 2  Concentration  on  Base  hser  Requirements 

Because  the  operating  base  is  the  logical  location  to  manage  the 
individual  engines,  its  user  requirements  will  drive  the  specification 
of  the  system  requirements  for  engine  monitoring.  The  TEFDI  survey, 
therefore,  was  designed  to  focus  on  the  critical  issues  of  base  level 
engine  management.  Over  half  the  scenarios  specifically  addressed 
maintenance  and  logistics  decisions  that  were  relevant  at  the  base 
level.  Selection  of  each  participant's  subset  of  question  was  weighted 
heavily  towards  these  scenarios  (QA  through  QF) . 
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Every  effort  was  made  in  the  selection  of  the  scenarios  to 
insure  that  the  survey  population  would  be  exposed  to  the  range 
of  capabilities  and  potential  options  available  via  an  integrated 
engine  monitoring/management  system.  Table  3  indicates  the  per¬ 
centage  of  the  survey  population  that  evaluated  some  of  the  key 
displays  and  access  modes  illustrated  in  the  survey. 

2 . 4  Participant  Time  Constraint 

Because  of  the  time  and  effort  required  to  respond  to  the 
quest ionaire ,  an  attempt  was  made  to  limit  each  participant's 
survey  to  four  or  five  scenarios.  This  limit  placed  a  constraint 
on  the  response  coverage,  particularly  at  the  command  level.  For 
that  reason,  selected  participants  with  experience  at  multiple  user 
levels  recieved  more  than  five  sections. 

2 . 5  Eng ine/A i r f rame  Manufacturer  Participants 

Five  surveys  were  assembled  for  members  of  the  engine  and  air¬ 
frame  manufacturing  community.  One  was  sent  directly  to  McDonnell 
Douglas,  The  other  four  were  forwarded  for  distribution  to  repre¬ 
sentatives  of  Pratt  5  Whitney,  General  Electric,  and  Detroit  Diesel 
Allison  Companies. 

III.  SURVEY  ANALYSIS 

The  following  section  contains  an  annoted  copy  of  the  survey 
with  discussion  of  the  development  of  each  section. 

5 . 1  Survey  Introduction 

The  survey  contains  a  short  information  section  that  includes 
participant  background,  general  instruction,  a  sample  question,  and 
a  glossary  of  terms  used  throughout  the  survey.  The  information 


B-7 


Table  3 

Survey  Participation  By  Key  Display  Types 


Participation 

Display  Type 

Scenario 

81 X 

Base  Status  Sumnary 

QA,  QC 

100% 

Engine  Profile 

QB,  QC,  QG 

66% 

Alarm  Capability 

QC 

** 

o 

o 

Diagnostic  Message 

QB,  QC,  QG 

79% 

GPA  Snapshot  and  Trend 

QB,  QG 

405 

Base  Engine  Removals 

QF 

79% 

Forecast  Capability 

QF,  QH,  QJ 

100% 

Base  Index  (Rank,  Sort, 
Group) 

QA,  QD,  QE 

40% 

Command  Index  (Rank, 

Sort,  Group) 

QI,  QJ,  QK 

26% 

Command  Status 

QK 
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Table  4 
Glossary 


GLOSSARY 

ALARM 

Alarm  is  a  report  from  the  monitoring  system  that  an 
engine  is  performing  outside  the  limits  of  normal 
operation. 

AUG 

Augmentor  modulo. 

AWM 

Awaiting  maintenance. 

CORE 

Core  module. 

CYCLES 

The  number  of  major  throttle  transitions. 

DELTA  TIT  (aTIT) 

The  remaining  temperature  uptrim  capability  measured  in 
control  adjustment  ratchet  clicks. 

ECP 

Engineering  Change  Proposal. 

EDS 

Engine  Diagnostic  System  is  an  on-boarc  aevice  that 
automatically  monitors  and  selectively  records  engine 
operating  data  for  diagnostic  purposes. 

iij 

ui 

Engine  electronic  control. 

SNMCS 

Engine  Not  Mission  Capable  due  to  Supply. 

EC 

Engine  Operating  Time  measured  in  nours. 

FVC 

Fully  Mission  Caoabie. 

GPF 

Gas  Path  Average  is  a  measure  of  an  engine's  performance 
relative  to  a  new  unit. 

HD*T 

High  Pressure  Turbine  module. 

HSI 

Hot  Section  Inspection  refers  to  maintenance  periodi¬ 
cally  performed  on  the  core  module. 

hs" 

Hot  Section  Time  at  temperature  levels  I  anc  II  is 
either  measured  in  hours  or  as  a  "  o *  tots’  engine 
operating  time. 

i  rz 

Low  Cycle  Fatigue  measured  in  cycles. 

_irE 

1 

Life  Limits  are  hour  or  cycle  limits  that  ■'equire  the  | 

’"eplacement  o*  a  component. 

Continued . . . 
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Table  4  (continued) 


•MAI  NT 

In  Maintenance. 

NMCS,  NMCM ,  ,'IMCB 

Not  Mission  Capable  due  to  either  Suoply,  Maintenance, 
or  Both  supply  and  maintenance. 

PMS 

Partially  Mission  Capable. 

SERV 

Serviceable  engine. 

SOAP 

Spectrometri c  Oil  Analysis  Program  determines  the 
metallurgical  composition  of  engine  oil.  Changes  in 
metal  composition  indicate  engine  wear. 

SPARES  RATE 

"  ratio  of  uninstalled  to  installed  engines. 

SQUAWK 

Pilot-reported  engine  deficiency. 

^  .  J 

Time  Compliance  Technical  Order. 

rMS 

Type,  Model,  and  Series. 

■nr 

Total  engine  Operating  ~ime  measured  in  hours. 
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section  is  shown  in  Table  4.  Table  5  is  an  excerpt  from  the  survey 
instructions.  It  discusses  the  purpose  of  the  survey  and  introduces 
the  concept  of  the  automated  management  system  CAMS).  Participants 
are  asked  to  assume  the  existence  of  a  video  terminal  that  allows 
them  to  access  information  from  the  AMS.  The  GPA  (gas  path  average) 
is  defined  and  identified  as  the  measure  of  engine  or  module  per¬ 
formance  . 

Table  5 

Survey  Instructions 


-  INSTRUCTIONS  - 

This  booklet  contains  a  survey  that  will  be  used  to  help  determine  how 
automated  engine  health  monitoring  can  be  used  to  increase  the  efficiency  of 
Air  Force  engine  maintenance  support.  Answer  the  questions  based  upon  your  job 
experience  and  feel  free  to  comment  in  the  spaces  provided.  We  will  use  both 
the  question  responses  and  the  comments  to  assemble  system  requirements  based 
on  your  needs. 

The  survey  is  composed  of  a  group  of  self-contained  sections.  Assume  that 
you  have  a  video  terminal  at  your  work  station  that  allows  you  to  communicate 
with  a  central  computer  which  we  have  called  the  automated  management  system 
(AMS).  Each  set  of  questions  is  based  upon  the  information  presented  on  the 
video  terminal  during  interaction  with  the  AMS.  We  have  reduced  the  size  of 
the  video  screen  for  the  survey.  Imagine  a  full  size  display  when  you  are 
considering  your  answers. 

An  important  goal  of  the  survey  is  to  evaluate  the  possible  impact  of 
engine  performance  monitoring  on  the  support  process.  Wa  have  used  a  generic 
derived  parameter,  GPA  (gas  path  average),  to  represent  the  output  of  an  engine 
performance  monitoring  system.  Consider  that  GPA  measures  engine  or  module 
performance  relative  to  a  new  unit.  Thus,  GPA=  100*  represents  acceptance 
performance  and  GPA  =  0*  represents  the  lowest  performance  experienced  in  any 
engine. 
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Each  section  includes  the  decision  scenario  and  the  ac¬ 
companying  display  system(s) .  Each  display  system  contains 
one  or  more  screens  of  information.  A  set  of  questions  fol¬ 
lows  each  display  system.  These  questions  are  directed  to¬ 
wards  the  specific  format  and  information  content  of  the  dis¬ 
play  screens.  A  final  set  of  questions  appears  on  the  last 
two  pages  of  each  subsection.  Figure  1  and  2  are  examples 
of  the  question  set.  Survey  particpants  are  required  to  rate 
each  system  according  to  clarity,  information  content,  and 
effectiveness.  Participant  response  was  used  to  determine 
overall  attributes  of  the  display  system.  In  the  clarity 
category  the  particpant  identifies  the  ability  to  recognize 
and  understand  the  data  display.  In  the  information  content  category 
he  ranks  displays  according  to  the  amount  of  information  required 
to  make  the  management  decision  introduced  in  the  scenario.  In  the 
effectiveness  category  the  participant  is  comparing  the  display 
system  presentation  relative  to  current  procedures  for  engine 
operations  and  support.  Participants  are  also  given  the  oppor¬ 
tunity  to  swap  screens  between  display  systems  and  to  design 
their  own  displays  on  a  blank  screen. 

3.2  Analysis  of  Survey  Displays  and  Questions 

The  following  paragraphs  analyze  each  of  the  eleven 
question  sections.  Each  scenario  is  presented  and  its  ob¬ 
jective  discussed.  The  formulation  of  the  data  displays 
summarizes  the  information  density,  display  format,  and  any 
special  techniques  demonstrated.  The  analysis  concentrates 
on  the  relationship  between  the  display  systems,  the  func¬ 
tional  modes  demonstrated,  and  the  questions  asked.  The 
accompanying  figures  are  from  the  survey. 


V, 
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-  INSTRUCTIONS  - 


We  are  interested  in  determining  some  of  the  overall  attributes  of  the 
Display  Systems  you  have  just  examined.  Before  you  answer  the  questions  below, 
leaf  through  the  pages  of  this  section  one  more  time  to  refresh  your  memory  of 
the  scenario  and  each  Display  System. 

We  want  you  to  rate  the  CLARITY,  INFORMATION  CONTENT  and  EFFECTIVENESS  of 
the  system  relative  to  the  management  objective  posed  in  the  scenario.  The 
ability  to  recognize  and  understand  the  data  display  visually,  defines  the 
system's  CLARITY.  Tabular  data  too  densely  packed,  poorly  defined  data  plots 
and  ambinuous  column  headings  would  detract  from  the  overall  CLARITY  of  a 
display.  The  amount  of  information  or  data  used  to  perform  the  scenario  man¬ 
agement  function  is  ranked  by  INFORMATION  CONTENT.  A  display  system  can  have 
too  many  or  too  few  categories  of  data  to  solve  the  posed  problem.  A  Display 
System's  EFFECTIVENESS  measures  the  ability  to  use  the  data  as  presented. 

Rank  the  system  relative  to  how  the  job  is  currently  done.  For  example,  if 
you  can  solve  the  scenario  problem  more  quickly,  conveniently  and  with  more 
confidence  than  at  present,  you  would  rank  the  system  more  effective. 


Check  the  categories  that  best  represent  your  evaluation  of  each  Display 
System. 


DISPLAY  SYSTEM  A 

DISPLAY  SYSTEM  B 

CLARITY 

very 

clear  :  :  :  obscure 

very 

clear  :  :  :  :  obscure 

INFORMATION 

CONTENT 

too  enough  Too 

much  •  :  :  :  little 

too  enough  too 

much  :  :  :  :  little 

EFFECTIVE¬ 

NESS 

more  same  less 

effective  :  :  :  :  effective 

more  same  less 

effective  :  :  :  :  effective 

Now  that  you  have  ranked  each  system  separately,  judge  which  Display  Sys 
tern  is  best  in  each  category. 


SYSTEM  A 

SYSTEM  B 

CLARITY 

INFORMATION 

CONTENT 

EFFECTIVE¬ 

NESS 

. 

Figure  1  Survey  Instructions  and  Questions 


P.  -  I 


Would  replacing  a  screen  in  Display  System  A  with  one  from  System  B  make 
System  A  more  effective? 

_ no  _ yes  (Specify:  _ ) 

Would  replacing  a  screen  in  Display  System  B  with  one  from  System  A  make 
System  B  more  effective? 

_ no  _ yes  (Specify:  _ ) 


-  OPTIONAL  - 

Use  the  blank  screen  below  to  design  a  display  to  replace  one  or  more  screens 
presented  in  the  previous  pages. 

Replaces  screen(s):  _ _ _ _ 


Comnents 


Figure  2  Survey  Questions  Format 
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3.3  QA-Bare  Base  Deployment 


Scenario : 

HQUSAF  has  given  TAC  a  requirement  of  deployment  to  a 
remote  location.  Mobility  Planning  has  ordered  Langley  AFB 
to  deploy  10  serviceable  F15's  and  five  spare  FlOO's  in  48 
hours.  This  will  be  a  bare  base  deployment  with  minimal 
maintenance  support  (if  an  installed  engine  cannot  be  re¬ 
paired  at  the  flightline  it  will  be  removed  and  replaced  with 
a  spare).  Over  the  two-week  deployment,  aircraft  are  scheduled 
to  fly  two  sorties  per  day.  Langley's  Chief  of  Maintenance  and 
the  Chief  on  the  Propulsion  Branch  must  recommend  to  TAC  which 
aircraft  and  spares  to  deploy.  To  make  this  recommendation 
they  need  to  know  which  of  the  fully  mission  capable  aircraft 
are  equipped  with  the  best  engines.  Any  aircraft  that  is  de¬ 
ployed  should  have  a  balance  of  life  (on  all  time/cycle  limited 
components)  to  support  the  sortie  rate.  The  Chief  of  Propulsion 
needs  to  know  the  status  of  his  serviceable  spares  to  determine 
whether  installed  engines  must  be  pulled  to  obtain  the  five  FlOO's 
necessary  to  deploy. 

Scenario  Objective: 

This  scenario  is  used  to  illustrate  three  index  functions; 
grouping,  ranking  and  finding.  The  user  is  provided  with  a  cur¬ 
rent  status  of  the  base's  engines  and  aircraft  via  a  grouped  dis¬ 
play.  Ranking  aircraft,  according  to  the  attribute  of  joint  en¬ 
gine  performance,  provides  a  list  of  aircraft  equiped  with  the 
highest  performing  engines.  Additional  engine  information  (time, 
cycles,  trim  adjustment,  ate.)  supplies  the  user  with  supporting 
data  for  his  recommendations.  Requesting  the  AMS  to  sort  the 
base  engine  files,  allows  the  user  to  identify  the  serviceable 
spares  available  for  deployment. 


■■■  . 
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display  system  a 

yol  ’-tiuest  'Our  automated  management  system  (Ah!S!  to  proviae  an  upaated  report  on 
.ancley's  status.  The  base  status  sumnarv  (screen  A-TJ  appears.  It  shows  the 
status  o *  aircraft  ana  engines  assigned  to  you r  base. 


DIS.PLAY  SYSTEM  A  (CONTINUED) 


You  reouest  the  AflS  to  indicate  the  serviceable  spare  engines 
currently  at  Langley  AF6.  Screen  A-3  appears. 


The  system 
reouest  is 
repeated  for 
reference. 


STOP  PLEASE  ANSWER  THESE  QUESTIONS  BEFORE  PROCEEDING, 


Screen  A-l  is  a  base  status  surmiary.  its  purpose  Is  tc  provioe  you  with 
the  informetior.  to  mane  a  quick  assessment  of  the  base's  status.  Rate 
tne  information  content  o'  screen  A-l. 


!s  there  any  information  you  would  eliminate  from  screen  A-l?  if  so,  mark 
through  it  directly  on  the  screen. 

Is  there  any  information  that  could  have  been  added  to  increase  the  effec¬ 
tiveness  and  clarity  of  screen  A-l?  If  so,  write  these  additional  items 
on  tne  screen. 

Screen  t-l  ranks  the  aircraft  on  engine  health.  Rank  tne  effectiveness  of 
using  GPA  as  a  ranking  factor  for  the  deployment  scenario? 


very 

valuable 

like 


worthless  0' 


uneb ie  to  score  | 
unetle  to  score 


Component  Lift  LIMITS  only  appear  i'  they  will  occur  witnir.  tne  next  ICS  j 
operating  hours.  What  oo  you  prefer’  | 

_____  The  IOC-hour  cutrf'  usee  or  screen  t-i  j 

_____  Ancthe'  hour  :utc*‘  (specify: 

~n<  comoonent  closest  tc  ’ts  l-'e  ’iir'ts  reoar;'»ss  o'  fme-cyc'es 

rema  i  ri  rc  . 

I 

Sorewert  or  C'SClay  lyster  A. 


•prcEcr  ?r  r;E'" 


DISPLAY  SYSTEM  B 


STATUS 
refers  tc 
the  mission 
caoabi 1 ity 

of  the  air¬ 
craft.  A/C 
’19  is  PMC 
for  an 
avi oni cs 
problem. 


too  request  your  AMS  to  proviae  an  updated  report  on  Langley's  status.  The  base 
statu:  summary  ^screen  B-i 1  appears.  It  shows  current  engine  status  anq  location. 


r 


SCREEN  B-l 


BASE  STATUS  MONITOR 

LANGLEY  AFB 


l»?i  u»wrt: 


FNG  installed 

ALARMS 

UN  I  NS 

TILLED 

RATE 

A/C 

rnc 

A/t 

PMC 

seRv 

"mainT 

Aun  ENrttS 

F 1 00  120 

10 

NONE 

*> 

w 

6 

3  6 

14* 

■■■ 

J 

Tou  now  request  the  AMS  to  rank  your  "TS'S  by  the  JOINT  SPA  rating 
(the  average  of  the  two  engines'  GPA  ratings  1.  Screen  B-?  appears. 
The  next  10  ranked  aircraft  can  be  displayed  by  a  simple  terminal 
input. 


SCREEN  B-2 


JOINT 
CPA  A/C 


H.f 

IM 
M.l 
*«.» 
99. « 


BASE  STATUS  MONITOR 

LANGLEY  AFB 

STATUS  Sr'N  CPA  EOT  LCF  ATIT 


I  MR 

itfi 

k 

1 9** 

k 

I  •  I  • 

k 

If** 

ltl« 

Iff* 


rue 

r*K 

rue 

P"C 

PRC 


M«l 
R«  If 
PW) 
•IH 

•  If* 

•  *•• 

•  Iff 
PHI 
•99- 

•  Iff 
•tff 
••»! 
Pit: 
•fff 
•9*  l 
•Ilf 

•  M3 
•If* 
•Iff 


91  .4 

>*9.3 

•at. i 

tti.i 

41.1 
*•*.* 
ttl.f 
Ifl.l 
3fl.| 
•«l  .1 
991.* 
ttl.f 
It*.  J 
HI.I 
•*1.9 
tti.a 
«ti .« 

111.1 


fff 

•tt 

fit 

m 


r»> 

•ti 

-ft 

fri 


itf 
ui 
•  »* 


~h£? 

I/II  COMMENTS 

jiirfT  — uw  — *■ 


ti<* 
f  t^ft 
PI'M 
ff'ff 


»*✓*! 
•*  *  ff 
It'll 

3*M«I 


4Ml 

ft-tt 

ti  '»1 


•ttc  co«t*tt» 


CIMIOk'lt* 


Figure  5  Survey  Module  Q\ 


lndivloual 
GPA  rating, 
engine  oper¬ 
ating  time 
(EOT),  cy¬ 
cles  (LCF), 
ana  trim 
status  (by 
clicks  re¬ 
maining)  are 
given  for 
each  engine, 
not  section 
time  ' PET ) 
is  giver, 
in  hours. 

The  COMMENT 
column  is 
used  tc  in¬ 
dicate  com¬ 
ponents 
within  'OC 
operating 
hours  o'  e 
time'eye !f 
1  im’ t 


PROCEED  TO  NEXT  PAGE> 
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DISPLAY  SYSTEM  B  (CONTINUED) 


O 


You  request  the  AMS  to  inOicttc  the  serviceable  spare  engines 
currently  at  Langley  AFB.  Screen  B-3  appears. 


BOSE  STATUS  MONITOR  MIH 

LANGLEY  AFB 


Hi  I 

S/N  STATUS  LOC  CPA  EOT  LOT  ATIT  I/I  I  COMMENTS 


mum .  mn.m* 


stop]  please  answer  these  questions  before  proceeding. 


Screen  B-1  is  a  base  status  summary,  its  purpose  is  to  provide  you  with 
the  information  to  make  a  quick  assessment  of  the  base's  status.  Rate 
the  information  content  of  screen  B-1. 


enough 


too 

little 


2.  Is  there  any  information  you  would  eliminate  from  screen  B-1?  If  so,  mark 
through  it  directly  on  the  screen. 

3.  Is  there  any  information  that  could  have  been  added  to  increase  the  effec¬ 
tiveness  and  clarity  of  screen  B-1?  If  so,  write  these  additional  items 
on  the  screen. 

4.  Screen  6-2  contains  information  on  each  engine's  health  rating  (GPA), 
operatina  time,  cycle  counts,  trim  adjustment,  hot  section  time,  and 
time/cycle  removals  within  the  next  100  operating  hours.  Is  there  any 
column  that  you  could  eliminate?  If  so,  draw  through  that  column. 

5.  Please  comment  on  Display  System  B: 


Display  Formulation: 


The  bare  base  deployment  scenario  is  accompanied  by  display 
systems  A  and  B  (Figure  3,  4,  5,  b)  .  Each  system  contains  three 
screens  of  information.  Tab’c  o  summarizes  display  density,  for¬ 
mat  and  special  techniques. 


Table  6 

Module  QA  Display  Formulation 


SYSTEM  A 

SYSTEM  B 

SCREEN  1 

High  Density;  Tabular 

Low  Density;  Tabu'ar 

SCREEN  2 

Medium  Density;  Tabular; 
Inverse  Video 

High  Density;  Tabular 

SCREEN  3 

Medium  Density;  Tabular 

High  Density;  Tabular 

Analysis: 


The  base  status  summary  (Screen  1)  is  a  key  display.  Its 
purpose  is  to  provide  base  level  personnel  with  a  quick  assess¬ 
ment  of  the  base's  status.  The  survey  evaluates  the  content  and 
organization  of  the  information  necessary  to  make  this  assessment. 
The  survey  participant  is  required  to  rate  the  information  content 
and  eliminate  unnecessary  data  or  add  any  items  that  would  increase 
display  effectiveness  and  clarity. 

Whenever  a  user  sorts  or  ranks  his  engine  files  on  an  attri¬ 
bute  (e.g.  serviceable  status,  joint  GPA)  he  obtains  a  fixed  set 
of  information  for  each  engine.  This  would  include  the  engine  or 
aircraft  serial  number,  status,  location,  and  summary  information 
such  as  GPA,  operating  time,  cycles,  etc.  By  evaluating  the  den 
sities  of  data  on  the  two  display  systems,  the  participant  identifies 
which  items  to  include  in  the  fixed  index  display  "Cv.  The  partici 
pant  also  indicates  preference"  for  presenting  HST  and  file  Limits 
in  a  1  terna  t  i  ve  format  r  GPA  was  used  as  the  ranking  1  actor  I  o  t  ?  :>• 
deployment  scenario.  The  participant  is  asked  to  rank  the  <•  i : <  c t 
iveness  of  using  GPA  fc v  identifying  the  aircraft  with  the  i  ov  ?  per 
forming  engines. 


3.4  QB-Pilot  Squawk 


Scenario : 

In  two  recent  sorties,  the  pilot  squawked  staggered  throttles 
and  low  performance  for  engine  119L  (P106).  After  conferring  with 
the  Chief  of  the  Propulsion  Branch,  the  engine  was  pulled  and  run 
across  the  test  stand.  The  test  stand  technician  reports  low  speed, 
high  fuel  consumption  and  high  temperature.  As  Branch  Chief,  you 
must  use  the  automated  engine  management  system  to  isolate  the  rea¬ 
son  for  low  performance  to  the  module  level  and  recommend  disposi¬ 
tion  of  the  problem. 

Scenario  Objective: 

This  scenario  is  used  to  test  the  engine  profile  function 
and  subsystem  displays  to  identify  and  isolate  the  cause  for  low- 
engine  performance  to  the  modular  level.  Displays  are  formulated 
to  identify  the  information  (e.g.,  GPA  rating,  time,  cycles,  HST 
(I/II),  etc.)  that  will  appear  on  the  profile.  Subsystem  displays 
address  the  health  of  the  individual  engine  modules. 

Display  Formulation: 

The  Pilot  Squawk  scenario  is  accompanied  by  two  display 
systems  (Figure  7,  8,  9,  10).  Each  display  system  contains  two 
screens  of  data.  Table  "  summarizes  display  density,  format,  and 
special  techniques. 


Table  7 

Module  QB  Display  Formulation 


SYSTEM  A 

SYSTEM  R 

SCREEN  1 

Low  Density;  Tabular; 

High  Den  s  i  t  v  ;  I'.thu  1  a  r  ; 

Inverse  Video 

Inverse  Video 

SCREEN  l 

Low  Density;  Tabular; 

H  i  gti  Dens  itv;  ('.  rap!,  l  c  a  1  ; 

Inverse  Video 

Historical  Trend 

Analysis  : 


The  engine  profile  contains  summary  statistics  and  diagnostic- 
information.  The  survey  participant  evaluates  the  content  and 
format  of  the  items  that  should  be  included  in  this  h  screen  dis¬ 
play.  Questions  specifically  address  the  approach  of  displaying 
certain  engine  information  on  exception  only  (i.e.  when  a  particular 
problem  exists) . 

The  subsystem  displays  present  information  on  modular  health. 
The  participant  rates  the  effectiveness  of  graphical  vs  tabular  in¬ 
formation  and  the  utility  of  trended  GPA. 

The  participant  evaluates  the  utilization  of  inverse  video 
to  highlight  messages  on  the  display  screen.  He  also  can  indicate 
a  preference  for  presenting  1 1ST  in  alternative  formats. 
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DISPLAY  SYSTEM  A 


You  request  the  AMS  to  provide  the  profile  or.  P106.  The  enolre  profile  (screen 
A. 11  appears  on  the  left  helf  of  your  vioeo  terminal.  It  conteins  summary  sta- 
tistics  ent!  diagnostic  information. 


SCREEN  A-l 


Cl fVT > 


ENGINE  PROFILE 
LRN6LEY  BFB 


NST(trlt) 
SCUTA  TIT 

'***TOT 


PI 06 ' s  aircraft  tail  number  Is  Indicated. 

NET  SPA  is  the  overall  health  rating  for  the 
engine.  It  measures  operating  performance 
relative  to  a  new  unit. 

Hot  section  time  (HST)  is  shown  as  a  I  of 
total  operating  time. 


Because  of  the  DIAGNOSTIC  message  and  the  flaggeo  low  NET  GPA, 
you  reouest  additional  sumrary  information  on  P106's  performance. 
Screen  A-;  appears.  The  module  health  ratine  is  current  to  the 
last  system  update  including  the  test  stand  results.  Because 
the  CORE  and  HPT  modules  are  crucial  to  total  engine  performance, 
they  dominate  the  NET  GPA  rating. 


SCREEN  A- 2 


awnm 

ENGINE  PROFILE 
_ LQNSLEY  OFB 


v: 


MODULE  HEBLTH  RRTINC 


FDT 

FBN 

BUG 


98 . 1 
95.8 
94  .6 


The  low 
health  rat¬ 
ings,  on  the 
CORE  anc  HP* 
indicate  that 
they  neat  me 
maintenance. 


Figure  7  Survev  Module  Ql’> 
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AG 
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PLEASE  ANSWER  THESE  QUESTIONS  BEFORE  PROCEEDING. 


1.  The  purpose  of  tne  engine  profile  (screen  A-l)  is  to  provide  summary  sta¬ 
tistics  and  diagnostic  information  on  the  engine.  Is  there  any  other 
summary  information  you  would  require?  If  so,  write  it  on  screen  A-"!. 

2.  Messages  have  been  highligntec  to  attract  your  attention.  Rate  the  effec¬ 
tiveness  of  this  technique. 

very 

effective  _  :  _  :  _  :  _  :  _  ineffective 

3.  Would  you  prefer  Hot  Section  Time  displayed  in  operating  hours  or  as  per¬ 
cent  of  EOT? 

_  hours  _ percent 

4.  Comment  on  Display  System  A: 


Figure  8  Survey  Module  QB 

"RO 


TC  NEXT  ?  AGE  ^ 


DISPLAY  SYSTEM  B 


You  request  the  AMS  to  provice  tne  profile  on  P10E.  The  engine  profile  I  screen 
B-l'  appears  on  the  le*t  naif  cf  vojr  video  termint'  .  It  contains  summary  sta¬ 
tistics  anc  diagnostic  information. 


SCREEN  B-l 


sct  rvn 


ENGINE  PROFILE 
LPNGLEY  PFB 


The  0£  status  means  that  the  engine  diag¬ 
nostics  system  (EDS',  and  on-board  sensors 
are  operating  normally  and  that  the  vibra¬ 
tion  and  oil  analysis  reports  are  within 
specified  limits. 


Because  of  the  DIAGNOSTIC  message  and  the  flagged  low  NET  SPA.  you 
reauest  additional  summary  information  on  P106's  performance. 
S'.~een  B-Z  appears.  The  module  health  ratine  is  current  to  the 
last  system  update  including  the  test  stand  results.  Because  the 


CORE  and  HP"  modules  are  crucial  to  total  engine  performance,  they 


/ 

/ 

GPA  TREND 
plots  GPA 
versus  total 
operating 
time  (TO') 
for  the 
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core  mooule. 
'he  graph 
shows  the 
effect  of 
two  hot  sec¬ 
tion  mainte¬ 
nance  actions 
on  engine, 
core  health 
rating. 


aominate  the  NET  GPA  rating. 
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Figure  9  Survey  Module  QB 
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PLEASE  ANSWER  THESE  QUESTIONS  BEFORE  PROCEEDING, 


1.  On  screen  B-l  £K  status  is  listed  for  a  number  of  categories  (for  example, 
EDS  and  SENSORS).  Should  this  information  be  displayed  only  when  a  prob¬ 
lem  exists? 

_ yes  _ no 

2.  Rate  the  effectiveness  of  the  bar  graph  used  to  show  the  module  health 
ratings  in  the  GPA  SNAPSHOT. 

very 

effective  _ : _ : _ : _ : _  ineffective 

3.  Rate  the  effectiveness  of  historical  information  provided  by  the  GPA  TREND, 
very 

helpful  _ : _ : _ :  _ ; _  useless 

_  I  don't  understand  it 


W.  Comment  on  Display  System  B. 


Figure  10 


Survev  Module  QB 


U-  > 


PROCEED  TO  NEXT  PAGE  t 


3.  5 


QC-Engine  Alarm 


Scenario : 

You  are  the  Chief  of  the  Propulsion  Branch  at  Luke  AFB. 

Late  yesterday,  a  member  of  the  Aircraft  Generation  Squadron 
reported  an  aircraft  (A/C  129)  with  an  off-idle  stall.  Because 
the  night  shift  was  shorthanded,  trouble-shooting  was  delayed. 

Last  night  the  automated  management  system  (AMS)  was  updated  with 
flight  acquired  performance  information  from  the  engine  diagnostic 
system.  As  Propulsion  Branch  Chief,  you  will  use  the  AMS  to 
identify  the  reason  for  the  off-idle  stall  and  direct  the  mainte¬ 
nance  activity  (e.g.  replace  sensor,  borescope  compressor,  pull 
engine ,  etc . ) . 

Scenario  Objective: 

The  purpose  of  this  scenario  is  to  illustrate  the  alarm 
function  of  the  engine  monitoring  system.  The  faulted  engine 
is  identified  on  a  grouped  display  such  as  a  base  status  listing. 
The  user  then  references  a  profile  summary  that  supplies  him 
with  relevant  diagnostic  data.  The  displays  allow  him  to  evaluate 
candidate  faults  such  as  RCW  of f -  schedule ,  actuator  failure,  ot 
TT25  sensor  failure. 

Display  Formulation: 

The  engine  alarm  scenario  has  display  system  A  and  B 
(Figures  11,  12,  13,  14).  Each  system  contains  two  screens 
of  information.  Table  8  summarizes  display  density,  format, 
and  special  techniques. 


Table  8 

Module  QC  Display  Formulation 


SYSTEM  A 

SYSTEM  B 

SCREEN  1 

High  Density;  Tabular; 

Low  Density;  Tabular; 

Inverse  Video 

Inverse  Video 

SCREEN  2 

Low  Density;  Tabular; 

High  Density;  Tabular 

Inverse  Video 

Inverse  Video 

B-  27 


Analysis : 


The  base  status  summary  is  a  key  display.  Its  purpose  is 
to  provide  base  personnel  with  the  information  to  make  a  quick 
assessment  of  the  base's  status.  Alarm  information  is  provided 
via  inverse  video.  The  survey  evaluates  the  content  and  organ¬ 
ization  of  the  information  necessary  to  make  the  status  assess¬ 
ment  and  identify  the  alarm.  The  participant  in  required  to 
rate  the  information  content  and  eliminate  unnecessary  data  or 
add  any  items  that  would  increase  the  displays  effectiveness 
and  clarity. 

The  engine  profile  contains  summary  statistics  and  diagnostic 
information  on  the  engine  with  the  major  alarm.  The  participant 
evaluates  the  content  and  format  of  the  items  that  should  be  in¬ 
cluded  in  this  screen  display.  He  also  rates  the  adequacy  of 
the  diagnostic  information  relative  to  specifing  maintenance  on 
the  faulted  engine.  Questions  are  directed  towards  the  utiliz- 
tion  of  inverse  video  representations  and  the  display  of  certain 
information  on  an  exception  basis. 


B-  2  3 


DISPLAY  SYSTEM  A 


You  request  your  automated  management  system  (AMS)  to  provide  en  updated  report 
on  Luke's  status.  The  base  status  summary  (screen  A-l)  appears.  The  purpose 
of  screen  A-l  Is  to  indicate  the  status  of  the  aircraft  and  engines  assigned  to 
your  bast.  Based  on  updated  performance  data,  the  A MS  reports  an  ALARM  on  P138. 


AIRCRAFT 
are  clas¬ 
sified 
according 
to  mission 
capability 


SCREEN  A-l 
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You  request  the  profile  of  the  engine  with  the  major  alarm 
(PUS).  The  engine  profile  (screen  A-21  aooears  on  the  left 
half  of  vour  video  terminal.  It  shows  summary  statistics  and 
diagnostic  information. 


SCREEN  A-2 


Uninstalled 
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to  repair 
status. 
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P138‘s  aircraft  tall  number  is  indicated. 

NET  GPA  is  the  health  rating  for  the  entire 
engine. 

Hot  section  time  (HST)  at  temperature  levels 
I  and  II  is  given  as  a  percentage  of  the 
total  operating  time. 

The  engine's  trim  status  (DELTA  TIT)  has  10 
click  positions  remaining. 

DIAGNOSTIC  information  indicates  that  the 
°CVV  it  H»low  the  t-im  hand  and  is  a  prob¬ 
able  cause  of  the  off-iole  stall.  The 
DIAGNOSTIC  message  Is  based  on  the  current 
engine  performance  data. 


Figure  11  Survey  Module  QC 
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PROCEED  TC  NEXT  PA6E> 


**4\ 


stop]  please  answer  these  questions  before  proceeding, 


Screen  A-1  is  a  base  status  summary.  Its  purpose  is  to  provide  you  with 
the  information  to  make  a  quick  assessment  of  the  base's  status.  Rate  the 
information  content  of  screen  A-1 . 

too  enough  too 

much  _ : _ : _ : _ : _ little 

Is  there  any  information  you  would  eliminate  from  A-1?  If  so,  mark  through 
it  directly  on  the  screen. 

Is  there  any  information  you  would  have  added  to  increase  the  effectiveness 
and  clarity  of  screen  A-1?  If  so,  write  these  additional  items  on  the 
screen. 

The  ALARM  and  DIAGNOSTIC  messages  for  engine  PI  38  were  highlighted  to 
attract  your  attention.  How  effective  was  this  technique? 


very 

effective 


ineffective 


The  engine  profile  (screen  A-2)  provides  summary  statistics  and  diagnostic 
information.  Is  there  any  additional  information  that  could  have  been 
added  to  the  profile  to  increase  its  effectiveness?  If  so,  write  these 
additional  items  on  screen  A-2. 

Would  you  prefer  Hot  Section  Time  displayed  in  operating  hours  or  as  a 
percentage  of  EOT? 

_ hours  _ percent 

/.  Is  the  diagnostic  information  that  is  provided  adeauate  for  making  your 
maintenance  decision? 


8.  Comment  on  Display  System  A: 


Figure  12  Survey  Module  QC 
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display  system  b 


You  request  .your  AMS  to  provide  an  updated  report  on  Luke's  status.  Screen  B-1 
appears .  It  snows  engine  status  anc  location.  Based  on  upoatec  performance  data, 
tne  AMS  reports  an  ALARM  on  PI 38. 
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SCREEN  8-1 


BASE  STPTUS  MONITOR 

luke  nr b 


Cl tVT) 


HIT  irmi,  nuunw 


ihstrllep 

RLPRMS 

UN  I NSTQLLED 

ROTE 

FMC 

P/C 

PMC 

SErv 

MPINT  AUH  ENMCS 

68 

8 

3 

5  2  4 

17'< 

You  request  the  profile  of  PI 38.  The  engine  profile  (screen  B-21 
appears  on  hair  of  vour  video  terminal.  It  contains  suninary 
statistics  and  diagnostic  information. 
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The  OK  status  means  that  the  engine  dieg^ 
nostic  system  and  on-poarc  sensors  are 
operating  within  tolerances  and  that  the 
vibration  and  oil  analysis  reports  are 
within  specified  limits. 


The  DIAGNOSTIC  message  provioes  information 
on  three  possible  reasons  'or  off-idle 
stall.  PCW's  be  lor  fm  band  is  give1-  as 
the  most  orcoable  cause. 


Figure  13  Survey  Module  QC. 
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1.  Screen  B-l  is  a  base  status  summary.  Its  purpose  is  to  provide  you  with 
the  information  to  make  a  quick  assessment  of  the  base's  status.  Rate  the 
information  content  of  screen  B-l. 


enough 


too 

little 


2.  Is  there  any  information  you  would  eliminate  from  B-l?  If  so,  mark  througi 
it  directly  on  the  screen. 

3.  Is  there  any  information  you  would  have  added  to  increase  the  effectiveness 
and  clarity  of  screen  B-l?  If  so,  write  these  additional  items  on  the 
screen. 

4.  On  screen  B-2  the  Ok  status  is  listed  for  a  number  of  categories  (for 
example,  EDS  and  SENSORS).  Should  this  information  be  displayed  only  when 
a  problem  exists? 


5.  DELTA  TIT  is  the  engine's  trim  status.  It  is  measured  in  click  positions 
(control  adjustment  racnets)  remaining.  How  essential  is  this  information- 

extremely 

essential _ : _ : _ _  : _ worthless 

_  I  don't  know 

6.  Is  the  diagnostic  information  that  is  provided  adequate  for  making  your 
maintenance  decision? 

exceptionally 

complete  _  :  _  : _ :  _  :  _ deficient 

7.  Comment  on  Display  System  B: 


b  s : 
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3.6 


D-TCTO  Management 


Scenario : 

As  Chief  of  Propulsion  at  Luke  AFB,  you  have  received 
notification  of  TCTO  2J-F100-545  for  modification  of  the  engine 
electronic  control  (EEC)  to  incorporate  a  modified  speed  trim 
adjustment.  You  have  been  informed  by  supply  that  they  have 
received  the  seven  modification  kits  that  Luke  AFB  requested 
three  months  ago  after  receiving  the  ECP.  The  TCTO  applies 
to  engine  serial  numbers  P108  through  P120,  and  P124  through 
P130.  Which  of  these  engines  are  assigned  to  Luke?  What  is 
their  status  (i.e.,  tail  number,  serviceable  spares,  mainten¬ 
ance  shop,  etc.)? 

Scenario  Objective: 

Satisfying  the  requirements  of  time  compliance  technical 
orders  has  been  identified  as  a  driver  for  a  large  portion  of 
the  maintenance  activity.  The  scenario  illustrates  the  function 
of  sorting  engine  files  on  the  serial  number  attribute.  By  re¬ 
questing  the  AMS  to  sort  the  base  engine  files,  the  user  can 
access  information  (e.g.  status,  location,  time,  GPA,  cycles, 
etc.)  on  each  of  engines  at  Luke. 

Display  Formulation: 

The  TCTO  management  scenario  is  accompanied  by  display 
systems  A,  B,  and  C,  (Figure  15,  16,  and  17).  Each  system 
contains  one  screen  of  information.  Table  9  summarizes  display 
density,  format,  and  special  techniques. 

Table  9 

Module  QD  Display  Formulation 


SCREEN  1 


SYSTEM  A 


SYSTEM  B 


SYSTEM  C 


High  Density; 
Tabular ; 
Inverse  Video 


Medium  Density;  Low  Dens  it 

Tabular/Graphical  Tabular; 

Additional 


y  ’< 

Sor 


B  ■  ‘ 


Analysis  : 


Whenever  a  user  sorts  his  engine  files  on  serial  numbers  he 
obtains  a  fixed  set  of  information  for  each  engine  assigned  to 
his  base.  This  would  include  the  engine  serial  number  (i.e. 
sorting  attribute),  status,  location  and  summary  information 
such  as  GPA,  operating  time,  cycles,  etc..  By  evaluating  the 
varying  densities  of  data  on  the  three  display  systems  the  part¬ 
icipant  identifies  which  items  to  include  in  the  fixed  index 
display  set.  HST  and  Life  Limited  information  can  be  represented 
in  alternative  formats.  Participants  are  requested  to  indicate 
the  preferable  format. 

Systems  A  and  C  are  used  to  evaluate  two  techniques  (inverse 
video  and  an  additional  sort)  that  allow  for  a  quick  differentia¬ 
tion  between  installed  and  uninstalled  engines. 


p,  -  i 


DISPLAY  SYSTEM  A 


vol  reouest  tne  automated  management  syster,  (AMS!  to  indicate  which  of  the  engines 
are  assigned  to  Luke  AE8.  Screen  A-1  appears  on  your  yioec  terminal.  Tne  engines 
are  listed  py  serial  numoer.  Uninstalled  engines  are  highlighted.  Location,  GPA, 
operating  cycle  counts,  and  trim  status  UTIT  in  clicks  remaining)  are  given  for 
each  engine.  Hot  section  time  (HST)  is  given  as  a  1  of  operating  time. 


COMMENT 
column  is 
used  to 
indicate 
components 
within  103 
operating 
hours  of 
time/cycle 
limits. 


The  system 
reouest  is 
repeated 
for 

reference. 


PLEASE  ANSWER  THESE  QUESTIONS  BEFORE  PROCEEDING . 


Screen  A-1  contains  information  on  each  engine's  current  location,  operat¬ 
ing  time,  cycles,  trim  status,  hot  section  time,  and  time/cycle  removals 
within  tne  next  100  operating  hours.  Is  there  any  column  you  could  elimi¬ 
nate?  If  so,  draw  through  that  column  on  the  screen. 

Would  you  orefer  hot  section  time  (HST)  displayed  in  hours  or  as  a  percent¬ 
age  of  EOT? 

_  hours  _ percent 

On-installed  engines  are  highlighted  on  screen  A-1  for  the  user's  conven¬ 
ience.  How  effective  is  this  technique? 

very 

elective:  _  :  _  :  _  :  _  :  _ ineffective 

Comment  on  Display  System  A: 


Figure  15  Survey  Module  QL)  cpn^cr* 
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DISPLAY  SYSTEM  B 


You  reguest  tft*  AMS  to  indicate  which  of  the  engines  are  assignee  to  Luke  AFB 
Screen  g-1  appear;  or  your  vioec  tenninal  .  The  engines  are  listed  by  serial 
number.  Status,  location,  GPA.  trim  adjustment,  ano  operating  time  are  given 
For  each  engine.  IIF-  LIMITS  within  tne  next  100  operating  nours  are  repre¬ 
sented  on  a  bar  graph. 


display  system  c 


You  request  the  AMS  tc  indicate  which  of  the  engines  are  assigned  to  Luke  AFB. 
Screen  C-)  aooears  on  yo ur  video  terminal.  Engines  are  listed  by  serial  num&er 
»n  installed  and  uninstalled  categories.  Status,  location,  &PA,  trim  adjustment 
and  lJF£  LIMITS  within  1(50  operating  hours  are  given  for  each  engine. 
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P LEASE  answer  these  questions  before  proceeding. 


1.  Screen  C-l  contains  information  on  each  engine's  current  location,  health, 
trim  status,  and  time/cycle  removals  within  the  next  100  operating  hours. 

Is  there  any  column  you  would  eliminate?  I*  so,  draw  through  the  column 
on  your  screen. 

2.  Is  there  any  additional  engine  information  that  you  would  reauire'  \*  so, 
write  these  items  on  screen  C-l. 

3.  The  AMS  automatically  sorts  the  installed  and  uninstalled  engines.  How 
beneficial  is  this  sorting  process? 

extremely 

beneficial  _ —  -  ■  _ *. _ _ _ ^worthless 

A  Component  lIMyTS  are  displayed  only  if  they  occur  within  the  next  1Q0  j 

ooeratmg  hours.  What  dc  you  p-efer-  ; 

_  The  100* hour  cute*'  used  in  c-l  | 

_  Another  hnu-  cu,,_o*f  (Specify _ __ 1  J 

rne  component  closest  tc  its  life  1  lifts  readrcless  c*  thp  time 
c/c  *e;  rema  mine  . 

c  yomrront  0*  C  i  S P a ■>  $  vs  ter 


Figure  17  Survey  Module  n[) 

dsoceec  t:  n ex~  =^ge| 


Scenario  : 

Squadron  119  at  Luke  AFB  reports  that  its  18  F15  aircraft 
have  experienced  severe  performance  degradation  in  the  last  seven 
weeks.  This  situation  could  potentially  result  in  a  greater-than- 
average  rate  of  engine  removals.  As  maintenance  officer,  you  sus¬ 
pect  the  special  combat  mission  that  the  squadron  has  been  flying 
since  19  April  1979  may  have  contributed  to  the  degradation.  119 
is  the  first  squadron  co  fly  this  particular  mission.  As  mainten¬ 
ance  officer,  you  would  like  to  compare  the  current  "health"  of  the 
squadron's  engines  to  their  "health"  when  the  mission  began. 

Scenario  Objective: 

This  scenario  illustrates  sorting  engine  files  on  squadron. 
Performance  information  via  GPA  is  displayed  for  each  engine  and 
selected  modules.  Various  approaches  to  the  presentation  of  derived 
engine  performance  variables  are  addressed. 

Display  Formulation: 

The  squadron  GPA  degradation  scenario  is  accompanied  by 
display  system  A  and  B,  (Figure  18,  19,  and  20).  System  A 
contains  two  screens  of  information,  while  system  B  contains 
one  screen.  Table  1 0  summarizes  display  density,  format,  and 
special  techniques. 

Table  10 

Module  QE  Display  Formulation 


Analysis : 

The  survey  participant  examines  tabular  and  graphical 
alternatives  for  displaying  performance/health  information 
for  the  engines  operated  by  Squadron  119.  He  evaluates  his 
ability  to  establish  the  trends  in  engine  and  modular  health 
from  the  tabular  data.  He  rates  the  effectivenss  of  plotting 
GPA  bar  graphs  for  the  current  date  and  19  April  1979  on  the 
same  graph.  This  technique  allows  the  user  to  quickly  esta¬ 
blish  the  trend  in  engine  and  core  health.  The  questions  in¬ 
troduce  the  concept  of  trending  engine  health  and  correlating 
the  trend  to  a  specific  engine  operating  mission. 


B-  39 


display  system  a 


You  reguest  your  automated  management  system  (AMS)  to  provioe  a  snapshot  of 
current  GPA  factors  for  Squadron  119.  Screen  A-l  appears  on  the  left  half  of 
your  video  termina 1 .  NET  GPA  measures  the  performance  of  the  overall  engine. 
It  rates  performance  relative  to  a  new  unit. 


SCREEN  A-l 
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T5~ 

80-  89 

4 

2  5 

10 

70-  79 

6 

6  7 

7 

60-  69 

9 

9  8 

4 

50-  59 

8 

10  9 

0 

40-  49 

6 

7  4 

0 

TOTAL 

36 

-> 

You  now  request  the  AMS  to  provide  the  GPA  SNAPSHOT  for 
19  April  1979,  so  that  you  can  compare  it  to  the  current 
distribution.  This  information  appears  on  tne  right  S'Oe  of 
vour  vioeo  terminal  (screen  A-Z). 


SCREEN  A- 2 
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BASE  STATUS  MONITOR 
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ENGINE 

GPA 

SNAPSHOT 

ENGINE 

CPA 

SNAPSHOT 
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TOTAL 
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Figure  18  Survey  Module  QE 


The  CORE, 
HPT,  and 
FAN  col¬ 
umns  list 
the  numper 
of  engines 
with  mod¬ 
ular  GPA 
factors 
in  each 
range. 
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PLEASE  ANSWER  THESE  QUESTIONS  BEFORE  PROCEEDING. 


What  is  the  general  trend  in  GPA  (health  rating)  for  Squadron  119  from, 
19  April  1979  to  06  June  1979? 

UP  DOWN 


NET  Engine  _  _ 

CORE  Module  _  _ 

HPT  Module  _  _ 

FAN  Module  _  _ 

Evaluate  how  you  were  able  to  establish  the  trend  in  engine  and  module 


health. 

very 

very 

auicklv  : 

;  •  slowly 

very 

with  great 

easilv  :  • 

:  :  difficulty 

Comment  on  Display  System  A: 


DISPLAY  SYSTEM  B 


You  request  your  AMS  to  provide  i  trend  of  engint  he»lth  (GPA)  for  the  current 
date  «nd  19  Apri'  1979.  You  specify  tMt  you  went  the  NET  GPA  trend  end  the 
CORE  GPA  trend  for  Squedron  119.  System  B-l  appears  on  your  vldee  terminal. 


r 


SCREEN  B-l 


t«L 


ENGINE  GPA  TRENb-SQD  119 

v 


BASE  STATUS  MONITOR 

LUKE  AFB 


Mpfgpm 


-»r  t—  m T t .  ’tarn 


CORE  4PA  TREND- SOT  1 T? 


The  Per  gripns  for 
ee ch  dete  eppeer 
over  eecn  other. 

The  trend  is  towero 
lower  ENGINE  end 
CORE  GPA  retings  et 
the  leter  oete  indi¬ 
cating  reduced 
squedron  cepebility. 


PLEASE  ANSWER  THESE  QUESTIONS  BEFORE  PROCEEDING. 


1.  Rate  the  clarity  of  plotting  the  engine  health  (GPA)  bar  graphs  for  the 
current  date  and  19  April  1979  on  the  same  graph. 

very 

dear  -  ;  -  :  _ __  .  _ .  _ obscure 

I  don't  understand  it 

2.  Screen  A-2  also  includes  the  health  information  on  the  CORE  modules  in 
Squadron  119.  What  other  modules,  if  any,  would  you  want  displayed? 

Other  modules:  _ _ _ 

Is  the  CORE  module  health  necessary?  _  No  _ Yes 

2.  Comment  on  Display  System  B: 


Figure  20  Survey  Module  QE 
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QF-  Base  Maintenance  Forecast 


Scenario : 

As  Chief  of  the  Propulsion  Branch  at  Myrtle  Beach  AFB , 
you  would  like  an  indication  of  the  engine  removals  expected 
on  a  monthly  basis.  Performance  and  time  data  are  collected 
and  monitored  via  the  A-10  Turbine  Engine  Monitoring  System 
(TEMS) .  A  trending  algorithm  is  used  to  predict  forced  re¬ 
movals  (time/cycle  limits)  and  removals  for  cause  (failure) . 

You  can  access  this  information  via  displays  on  your  automated 
management  system  (AMS) . 

Scenario  Objective: 

This  scenario  introduces  the  concept  of  forecasting 
engine  removals  based  on  operating  hours  and  current  engine 
performance.  The  user  is  provided  information  for  two  cate¬ 
gories;  predicted  removals  driven  by  component  time/cvcle 
limits  and  predicted  failures. 

Display  Formulation: 

The  base  maintenance  forecast  scenario  has  display  systems 
A  and  B,  (Figure  21,  22,  23,  and  24).  Each  system  contains  two 
screens  of  data.  Table  11  summarizes  display  density,  format,  and 
special  techniques. 


Table  11 

Module  QF  Display  Formulation 


SYSTEM  A 

SYSTEM  B 

SCREEN  1 

SCREEN  2 

High  Density,  Tabular 

High  Density;  Tabular 

High  Density;  Tabular 

Med.  Density;  Graphical 

B  -  4  3 


Analysis : 


During  the  orientation  visits,  base  maintenance  personnel 
indicated  a  need  for  a  tool  to  help  forecast  engine  removals 
based  on  time/cycle  limits  and  performance  degradation.  The 
survey  participant  is  required  to  evaluate  the  information 
necessary  to  specify  forced  removals  (e.g.  estimated  data, 
engine,  aircraft  tail  #  location,  component  driving  the  re¬ 
movals,  and  cycles  or  hours  remaining).  For  the  predicted 
failures,  the  user  is  requested  to  help  identify  the  proba¬ 
bility  or  confidence  interval  he  would  require  placed  on  the 
forecast.  The  participant  can  also  identify  any  additional 
information  he  would  need  on  the  engines  scheduled  to  fail. 


B  -  1  -1 


DISPLAY  SYSTEM  A 


The  remov¬ 
als  are 
ordered  in 
time.  A 
simple 
terminal 
input  to 
tne  AMS 
provides 
you  with 
tne  next 
group . 


Tne  ronov- 
als  are 

ordered  in 
time.  A 
simple 
terminal 
inout  to 
tne  A  'S 
provides 
you  with 
tne  next 
trout . 


You  request  tne  automated  management  system  (AMS)  to  provioe  a  forecast  of  time/ 
cycle  removals.  Screen  A-l  appears  on  vour  video  terminal.  The  forecast  is 
based  on  accumulated  operating  Hours  (as  of  06  June  19791  and  Myrtle  Beach  AFB's 
•'lying  profile.  The  forecast  includes  engine  serial  numoer,  tail  number  location 
(IOC),  estimated  removal  date  (EST),  and  the  hours/cycles  remaining  on  the  com¬ 
ponent  forcing  tne  engine  removal. 
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SCREEN  A-l 


SSL. 


BASE  STATUS  MONITOR 

MYRTLE  BEACH  QFB 
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nil  uoart,  «VJUN«> 
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irr  sTtc t  tn  k.»ki 
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i:u 
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itr  tract  n*t  MKl 
1ST  tract  conaccuo*  liu 
ram  us* 

1ST  tract  art  mki 
1ST  tract  m*t  k«Ri 


You  request  the  AMS  for  forecast  removals  due  to  engine  failure 
or  severe  performance  degradation.  Screen  t-2  appears.  The 
forecast  is  based  or  the  engine's  current  health  (SPA)  and  the 
rate  at  which  the  engine  s  health  is  deteriorating. 
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Figure  21  Survey  Module  QF 
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j^STOPj  PLEASE  ANSWER  THESE  QUESTIONS  BEFORE  PROCEEDING. 


1.  Is  there  additional  information  you  would  require  on  the  engines  forecast 
for  time/cycle  removals  (screen  A-T ).?  If  so,  write  the  items  on  the 
screen. 

2.  Is  an  80*  probability  of  failure  accurate  enough  for  base  planning  pur¬ 
poses? 

_ yes  _ no 

3.  Is  there  any  additional  information  you  would  require  on  the  engines  pre¬ 
dicted  to  fail?  If  so,  write  the  items  on  the  screen. 

4.  How  important  to  base  maintenance  planning  would  a  good  monthly  forecast 
of  engine  removals  be  (both  for  failure  and  time/cycle  limits): 

critical  _ : _ :  _ _ :  _ : _ useless 

5.  Comment  on  Display  System  A: 


Figure  22  Survey  Module  OF 
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DISPLAY  SYSTEM  B 


You  reouest  the  A MS  to  provide  a  forecast  of  time/cycle  removals.  Sc-*en  6-1 
appears  on  vour  viaeo  terminal.  The  forecast  is  based  or  accumulates  operating 
hours  (as  of  06  June  1979)  and  Myrtle  Beach  APB's  flying  profile. 


You  request  the  AMS  to  forecast  rasnovals  due  to  engine  failure  or 
severe  performance  degradation.  Screen  B-Z  appears.  It  shows 
the  numoer  of  engines  in  each  S-po'ht  SPA  .ntervel.  The  engines 
with  a  low  WET  SPA  are  wort  likely  to  fail  if  the  prediction  is 
made  for  the  next  three  tenths. 


5  engines 
ere  pre¬ 
dicted  to 
fail  in 
July. 

a  engines 
in  August. 

5  engines 
in  Sep¬ 
tember. 


The  H 
engines 
with  the 
lowest  GPA 
factors 
ere  shown. 


Figure  23  Survey  Module  QF 
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Screen  B-2  uses  a  bar  graph  to  represent  the  number  of  engines  in  each  GPA 
'r.terval.  The  engines  with  the  lowest  rating  are  more  likely  to  fail  and 
are  indicated  by  the  different  bar  graphs.  Rate  the  effectiveness  of  this 
technique. 

very 

effective  _  :  _ *•  - : -  •’  - ineffective 

_  I  don't  understand  it 

Comment  on  Display  System  B: 
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QG-On-Condition  Maintenance  Team 


Scenario : 

The  On-Condition  Maintenance  (OCM)  Team  at  San  Antonio-ALC 
consists  of  the  team  chief,  an  engineer,  a  technician,  and  repre¬ 
sentatives  from  scheduling,  production,  and  quality  control.  It 
is  near  the  first  of  the  month  and  SA-A.LC  has  received  an  F100 
engine  (P106)  from  Luke  AFB.  Engine  overtemp  was  the  removal 
reason  cited  by  base  maintenance  personnel.  In  addition,  Luke 
flagged  the  engine  for  an  abnormal  SOAP  report  and  high  vibration 
on  the  gear  box.  As  an  OCM  team  member,  you  can  access  certain 
information  on  P106  via  an  automated  management  system  (.AMS)  . 

Scenario : 


The  process  of  prescribing  on-condition  (or  conditional) 
maintenance  requires  information  contained  in  the  engine  profile 
and  subsystem  summaries.  This  scenario  will  be  used  to  determine 
which  portions  of  the  base  engine  record  must  be  transferred  to 
the  CDB  when  an  engine/module  is  returned  to  the  depot  for  repair 
Candidate  items  for  incorporation  in  the  display  include  removal 
cause,  diagnostic  and  performance  information,  balance  of  life  on 
time/cycle  limited  components,  SOAP,  vibration  plots  and  mainte¬ 
nance  . 

Display  Formulation: 

The  OCM  scenario  is  accompanied  by  display  system  A, 
which  contains  five  screens  of  data,  (Figure  25,  26,  2',  and  28). 
Table  12  summarizes  display  density,  format,  and  special  tech¬ 
nique  s . 


B  -  -1  9 


.  • j  ,»u.  •atsufi  x 


Table  12 

Module  QG  Display  Formulation 


SYSTEM  A 

SCREEN 

1 

High  Density; 
Tabular ; 

Inverse  Video 

SCREEN 

2 

High  Density; 
Graphical ; 

Trended  Data 

SCREEN 

3 

High  Density; 
Graphical ; 

Trended  Data 

SCREEN 

4 

High  Density; 
Tabular /Graphical ; 
Trended  Data 

SCREEN 

5 

Medium  Density; 
Tabular 

Analysis : 

The  engine  profile  provides  summary  statistics  and  diagnostic 
information  on  the  engine  that  has  been  transferred  from  Luke.  High¬ 
lighted  messages  direct  the  OCM  team  to  request  additional  subsum¬ 
mary  displays.  The  participant  identifies  the  set  of  statistics  he 
wants  to  appear  on  the  profile  and  rates  the  effectiveness  of  the 
inverse  video  representation. 

Two  graphical  modes  are  used  to  display  engine/module  health. 

The  GPA  snapshot  provides  a  relative  picture  of  current  module 

health.  The  participant  evaluates  the  effectiveness  of  the  bar 

graph  representation.  Trended  GPA  history  (for  the  overall  engine 

and  core)  is  plotted  against  total  engine  operating  time.  The  effect  of 

two  hot  section  inspections  on  engine/core  performance  is  illustrated. 

This  helps  to  correlate  the  effect  of  maintenance  and  performance.  The 

participant  indicates  the  effectiveness  of  these  displays. 

SOAP  and  recent  vibration  history  are  also  available  to  the 
OCM  team  via  displav  system  A.  The  participant  evaluates  his  re¬ 
quirements  for  this  information  and  indicates  the  essentialness  and 
effectiveness  of  the  graphical  displays. 


P, 


Engine/module  maintenance  history  is  available  from  a  number 
of  sources  (MMICS,  AF  forms  781E  and  95).  Screen  A-4  presents  an 
additional  alternative  for  providing  historical  information  and 
referencing  it  to  engine  operating  and  calendar  time.  The  survey 
participant  evaluates  the  utility  of  this  method  for  displaying 
history . 

The  AMS  provides  a  list  of  recommended  opportunistic  main¬ 
tenance  for  time/cycle  component  replacements  and  TCTO's.  The 
participant  evaluates  this  display  option  relative  to  the  in¬ 
formation  currently  available  for  specifying  opportunistic  main¬ 
tenance  . 
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display  system  a 


You  request  your  automated  management  system  (AKS)  te  provide  the  profile  for 
?106.  The  encme  p-o*ile  isc-^er  A-l*  appears  or  the  left  siae  of  vour  video 
terminal .  It  shews  sutrmary  statistics  anc  diagnostic  information. 


SCREEN  A-; 


NET  GPA  is  the  overall  health  rating  for  the  engine. 
It  measures  operating  performance  relative  to  a  new 
unit. 


Hot  section  time  (KST)  is  snown  as  a  \  of  total  oper¬ 
ating  time  (TOT). 

The  Ok  status  indicates  that  the  diagnostic  system 
(EDS;  ana  on-board  sensors  are  operating  normally. 

Vibration  (VI6 }  message  indicates  the  gearpox  (G/Bl  is 
above  the  TC  limit,  the  SOAP  message  inoicates  an  ab¬ 
normal  increase  in  nickel  (NI)  particles  in  tne  oil 
sample . 


DIAGNOSTIC  message  indicates  an  overtemc  condition  on 
the  engine. 


You  first  -eouest  additional  information  on  pl06‘s  performance. 
Screen  apoea-s  or  tne  vicec  temnal.  Each  moaule  in  the 
gas  patn  has  its  owr.  healtn  rating.  Because  CORE  ana  HP"  moa- 
ules  are  crucial  to  total  engine  pe-f ormance ,  they  dominate  the 
N£~  SPA  rating.  A  low  health  rating  ( <50* 1  inaicates  a  module 
may  require  maintenance. 


G?A  SNAPSHO’  shows 
the  me ■'vi dual  moaule 
health  -sting  as  of 
the  last  uooate. 


G?A  "PEND  Diets  GpA 
vs.  tota'  ope-atinc 
time  TOT*  for  the 
overal'  enome  anc 
rne  co-e  moouie.  "he 
graph  snows  tne 
e**'ect  t*  twe  not 
settlor  maintenance 
actions  or  enc'rie 
:o-e  nes’t-  -at* net 


"he  n-jmoe-t  above  tr*> 
^S1  indicate  erfies 
■>f.  »_he  - 1 S  T  C  p  v  s c - e e - 
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ENGINE  PROFILE 
TFPjjSrER  FROM  LUKE  QFB 
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\Z 


AO-A093  226  SYSTEMS  CONTROL  INC  (VT)  PALO  ALTO  CA  F/6  21/5 

TURBINE  ENGINE  FAULT  DETECTION  AND  ISOLATION  PR06RAM.  PHASE  I.  — ETCCU) 
APR  80  L  E  BAKER.  R  L  DE  HOFF.  W  E  HALL 
UNCLASSIFIED  AFWAL-TR-80-2053-VOL-2  NL 


DISPLAY  SYSTEM  A  (CONTINUED) 


Because  of  the  VIE  and  SOAP  message  you  request  recent  vibration 
history  and  oil  analysis  for  P106.  Screen  A-3  appears.  Abnor¬ 
malities  are  automatically  highlighted  on  your  video  screen. 


V 


/HiMBUI 

ENGINE 


SCREEN  A-S 


PROFILE 
TRANSFER  FROM  LUKE  AFB_ 
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VIBRATION 
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~  1  — 

4.1  .M 

• 

-»*■ 

^ ^  --/V 

i 

i — ns — in  mi  wnw — a 

i 

VIBRATION  (measured  in 
mils)  is  plotted  over 
the  last  A?  operating 
hours  for  the  gearbox 
(G/B),  the  diffuser 
case  (D/C) .  and  the 
fan  case  (P/C). 


The  calculated  rate  of 
change  in  nickel  (Nl) 
and  iron  (Fe)  is 
plotted  versus  total 
operating  time. 


To  assist  in  your  assessment  of  P106,  you  request  some  recent 
maintenance  history.  Screen  A -A  appears  on  vour  video  terminal. 
The  HISTORY  report  lists  the  sis  most  recent  maintenance  events. 
By  a  simple  terminal  input  you  can  display  older  history.  Engine 
ooeratina  tine  (EOT)  is  plotted  versus  calendar  months.  The 
horizontal  lines  represent  the  operating  hour  when  a  module  must 
be  removed  to  replace  a  time/cycle  limited  component. 


SCREEN  A-4 
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ENGINE  PROFILE 
TRANSFER  FROM  LUKE  PFB_ 


HISTORY 
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The  numbers  above  the 
maintenance  action 
reference  entries  in 
the  HISTORY. 


Figure  26  Survey  Module  QG 
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DISPLAY  SYSTEM  A  (CONTINUED) 

In  order  to  specify  opportunistic  maintenance ,  you  need  to  know 
which  components  ere  approaching  tlaa/cycle  limits  and  which 
TCTO's  are  outstanding.  You r  AMS  can  proride  a  list  of  recom¬ 
mended  component  replacements  and  suggested  TCTO's.  You  reouest 
this  report  and  screen  A-5  appears. 


SCREEN  A-5 


PROFILE 
OH  LUKE  AFB 


RECOMMENDED  OPPORTUNISTIC 
MAINTENANCE 

TIME^CYCLE  REPLACEMENTS 
ITEM  S/N  BAL 


ItN 
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TCTO  DESCRIPTION 

wcamn  ruCL/tiL  cwui  tutu* 
Tj-riM  »rr  i artau  mt  nmwiina  wn 

Tjrfm  ui  latacct-acaaia  tee 


AMS  shows  component 
name,  serial  number 
(S/N),  and  remaining 
life  (BAl)  In  hours 
and  cycles. 


AMS  lists  the  TCTO 
number  and  a  brief 
DESCRIPTION. 


Figure  27  Survey  Module  QG 


B-5< 


PROCEED  TO  NEXT  PAGE| 


PLEASE  ANSWER  THESE  QUESTIONS  BEFORE  PROCEEDING. 


Tn«  ourpose  0*  tnt  *0910*  profit  iScreen  A-1)  is  to  provioe  summary 
infprmation  on  th#  engine.  Is  then*  any  otn*r  summary  information  you 
would  reouire?  If  so,  writs  it  on  screen  A-1 . 

2.  Messages  on  screen  A-1  hive  peer  highlignted  to  attract  your  attention  to 
engine  problems  and  diagnostic  information.  Rate  the  effectiveness  of 

j  this  tecnniaue. 

I  very 

j  effective  _____  :  -  :  _  :  _____  :  _____  ineffective 

3.  Rate  the  effectiveness  of  the  Oar  graph  used  tc  show  the  module  health 
ratings  in  the  GPA  SNAPSHOT  (screen  A-2). 

very 

effective  _____  :  .  :  _____  :  _____  :  ineffective 

A.  Rate  the  effectiveness  of  the  historical  information  provided  by  the  SPA 
TREND  (screen  A-2). 

very 

helpful  _____  :  _____  :  _ :  _  :  useless 

_____  1  don't  understand  it 

5.  Rate  tne  benefits  of  displaying  the  recent  vibration  history  for  tne  gear 

bos,  tne  diffuse'  case,  and  the  fan  case. 

very 

helpful  _____  :  _ :  _ :  ^____  :  _ useless 

_  1  don't  unoerstand  it 

6.  Rate  tne  desirability  df  including  SOAP  information  on  the  OCM  team. 

very  not 

essential  _ :  ___^_  :  _____  :  —  :  renuired 

7.  The  OK  ANALYSIS  plot  deDicts  particulate  rate  of  cnanoe  Over  engine  oper¬ 
ating  hours  rathe-  than  tne  parti  tv ’ate  ieve'  Evaluate  the  effectiveness 
of  the  OIL  ANALYSIS  graph  (screen  A-3)  used  to  present  the  assay  results. 

very 

effective  ^___  :  _  :  _____  :  _____  :  _ ineffective 

^____  I  don't  understand  it 

E.  How  effective  is  the  maintenance  HISTORY  and  engine  operating  time  dis¬ 
played  on  screen  A-a? 

very 

effective  _____  :  ____  :  _____  :  _____  :  _ ineffective 

I  don '  t  understand  i  t 

9.  How  would  you  prefer  engine/mainter.ance  nistcry  presented  to  the  OC": 
_____  As  in  screen  A-A 

_  Screen  A-A  plus  forms  781E  and  95 

_  MM JCS  TRE 

_  Other  (specify:  ) 

1C.  On  screen  A-S  the  AMS  displays  the  lift  limited  components  tnat  4t 

-etommeno;  *0-  replacement,  woulc  you  prefer  this  -ecommendation  or  a 
comoiett  ''Stine  of  components  witr  cycle/hour  balances  (G337.3017): 

_  Recornnenoed  replacements  as  in  screen  A-S 

_  G337.3C17  listing 

i  _____  Ctner  'specify  ) 

rOu  1  c  you  ;re'e-  tne  AMS  tc  o'oviae  tne  enf-e  list  0'  outstanding  TCTC's 
o-  tc  cisola.  only  tnose  *:*C ■ s  tne  AMS  -ecoiinienes  'or  comeletior  curing 
tnis  cur-ert  repair 

_  tnt're  -St  c*  outstanding  'C'C  s  j 

_  Recommenced  TCi  only 

_  Entire  -st  c'  *C*C  s  wit'  'ecommenoe:  ones  highlighted. 


Figure  2g  Survey  Module  QG 
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3.10  QH-Maintenance  Forecast 


Scenario : 

You  are  the  TF34  engine  manager  at  San  Antonio  ALC. 
Engine  performance  data  are  collected  and  monitored  via  the 
A- 10  Turbine  Engine  Monitoring  System  (TEMS) .  A  trending 
algorithm  is  used  to  predict  the  engines  expected  for  re¬ 
moval  for  depot  level  repair.  You  can  access  this  infor¬ 
mation  to  determine  how  many  TF34  engines  SA-ALC  can  expect 
from  Myrtle  Beach  AFB  next  month. 

Scenario  Objective: 

This  scenario  introduces  the  concept  of  forecasting 
monthly  engine  removals  and  expected  depot  returns  via  an 
interactive  routine.  The  engine  manager  supplies  the  base, 
the  month,  and  the  engine  type  and  AMS  provides  removal  in¬ 
formation. 

Display  Formulation: 


The  maintenance  forecast  scenario  is  accompanied  by 
one  display  system  with  two  screens  (Figure  29  and  30  )  .  The 
first  screen  illustrates  an  interactive  input  menu;  the  second 
screen  provides  the  output.  Table  13  summarizes  display  density, 
format,  and  special  techniques. 

Table  13 

Module  QH  Display  Formulation 


Analysis : 


The  ability  to  improve  forecasts  of  engine  removals 
(based  on  engine  performance/health  data)  has  been  ident¬ 
ified  as  a  candidate  benefit  from  automated  TEMS.  The 
survey  evaluates  the  benefits  of  such  a  capability.  The  part¬ 
icipant  rates  the  management  effectiveness  of  the  display 
system  and  specifies  the  required  accuracy.  He  also  in¬ 
dicates  any  requirement  for  additional  data  on  engines 
predicted  for  removal. 


DISPLAY  SYSTEM  A 


You  request  the  automated  management  system  to  provide  the  SA-ALC  FORECAST 
program.  Screen  A-l  appears  on  vour  video  terminal.  The  forecast  program 
is  user-interactive.  You  must  specify  answers  to  the  three  questions  that 
the  AMS  asks. 


SCREEN  A- 1 


DEPOT  STATUS  MONITOR 

Sfl-QLC  FORECAST 


unt  omj  a— 


BASE? 

MONTH? 

ENGINE? 


x: 


You  type  in  the  request  for  the  prediction  of  TF34  engine 
removals  at  Myrtle  Beach  AFB  for  July.  Screen  A-2  appears. 

It  lists  the  number  of  EXPECTED  REMOVAL  for  failure  (CAUSE) 
and  operating  limits  (TIME/CYCLE).  Three  of  the  engines  are 
likely  to  be  returned  to  the  depot.  The  engines  are  identified. 


I 


SCREEN  A- 2 


r 


DEPOT  STATUS  MONITOR 

SQ-QLC  FQRECRST 


'  r.  I  i  v  i  i 


imp 

QSQI 


BASE? 

MONTH? 

ENGINE? 

EXPECTED  REMOVALS  10 

TOR  CAUSE  5 

TOR  TIME/'CYCLE  5 

EXPECTED  RETURNS  TO  DEPOT  3 


£r!3  avsTLE 

E2BS  MYRTLE 
E  1 2 A  MYRTLE 


GPA 
4572 
49  .3 
61  .3 


FAILURE 

TIME'CYCLE 


v: 


Figure  29  Survey  Module  QH 
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The  low  SPA 
reting  in¬ 
dicates 
severe  per¬ 
formance 
degradation 
ana  t  high 
probabi lity 
of  engine 
fei lure. 
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STOP!  PLEASE  ANSWER  THESE  QUESTIONS  BEFORE  PROCEEDING, 


Rate  the  management  effectiveness  of  a  monthly  forecast  of  expected  engine 
removals  and  depot  returns  based  on  engine  performance  and  health. 


extremely 

valuable 


worthless 


2.  How  much  accuracy  would  you  require  of  a  forecast: 

_ Correct  more  than  90S  of  the  time 

_  Correct  more  than  80S  of  the  time 

_  Correct  more  than  70S  of  the  time 

_  No  opinion. 

3.  Screen  A>2  provides  serial  number,  health  rating  (GPA),  and  probable 
removal  cause  with  each  engine  forecasted  for  return  to  the  depot.  Is 
there  additional  information  you  would  like  for  the  engines?  If  so, 
write  these  items  onto  the  screen. 

4.  Comment  on  Display  System  A: 


Figure  30  Survey  Module  QH 
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3.11  QI -Multiple  Base  Deployment 
Scenario : 

TAC  has  received  orders  from  HQUSAF  to  deploy  10  F15’s 
and  sufficient  spare  engines  to  a  remote  location  for  14  days. 
You  may  choose  engines  from  two  bases  (Luke  and  Langley)  to 
support  the  deployment.  Aircraft  are  scheduled  to  fly  two 
sorties  per  day.  On-site  maintenance  will  be  limited.  You 
have  one  weeks  lead  time  to  plan  for  the  deployment.  Which 
aircraft  and  which  spare  engine  should  you  deploy? 

Scenario  Objective: 

The  concept  of  an  interactive  routine  to  help  plan 
command  level  deployments  is  addressed  in  the  display 
systems  that  accompany  this  scenario.  The  proposed  TAC 
deployment  planner  would  question  the  user  on  various 
details  of  the  deployment  (e.g.  duration,  sortie  rate, 
maintenance  support,  mission  profile,  etc.).  Based  on 
his  requirements  the  user  would  be  provided  with  the 
optimum  combination  of  engines,  aircraft  and  spares  to 
support  the  deployment. 

Display  Formulation: 

The  multiple  base  deployment  is  accompanied  by  dis¬ 
play  system  A  and  B,  (figure  31,  32,  33,  34,  and  35).  Screen 
1  and  2  for  both  systems  illustrate  the  interactive  input  menu. 
System  A  has  one  output  display  and  System  B  has  two.  Table 
14  summarizes  display  density,  format,  and  special  techniques. 


J 
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Table  14 

Module  QI  Display  Formulation 


SCREEN 

1 

Medium  Density;  Tabular 

Medium  Density; 

Menu 

Tabular;  Menu 

SCREEN 

2 

Medium  Density;  Tabular 

Medium  Density; 

User/Interactive 

Tabular;  User/ 
Interactive 

SCREEN 

3 

Medium  Density;  Tabular 

High  Density; 

Inverse  Video 

Tabular;  Inverse 
Video 

SCREEN 

4 

High  Density; 
Tabular;  Inverse 
Video 

Analysis : 


The  survey  evaluates  the  TAC  Deployment  Planner  as  a 
planning  tool  at  the  command  level.  The  participant  in¬ 
dicates  any  requirement  for  additional  information  on  re¬ 
commended  engines  and  aircraft.  The  option  of  using  the 
AMS  to  calculate  spares  requirements  based  on  the  deploy¬ 
ment  flying  schedule  and  engine  health  is  evaluated. 
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DISPLAY  SYSTEM  A 


You  request  the  automated  management  system  (AMS)  to  provide  the  TACTICAL 
DEPLOYMENT  PLANNER.  Screen  A-1  appears  on  vour  video  tenninel.  The  PLANNER  is 
user-interactive.  You  must  specify  information  concerning  the  deployment. 


ast-i, 


SCREEN  A-1 


TAC  FLEET  STATUS 

DEPLOYMENT  PLQNNER 


1.«IT  nji 


DAYS  LEFT 
BASE  SUPPORT 
SORTIE  RATE (PER  DAY) 
DURATION (DAY) 
AIRCRAFT  TYPE 
NUMBER 

ELIGIBLE  BASES 
CALCULATE  SPARES 


DAYS  LEFT  is  lead 
time. 

BASE  SUPPORT  is 
degree  of  on-site 
maintenance.  SORTIE 
RATES  is  the  flying 
schedule.  DURATION 
is  the  deployment 
length.  The  PLANNER 
is  programed  to 
calculate  the  number 
of  scares  required 
to  support  the 
deployment  specified. 


You  input  the  information  that  you  have  been  provided  by  HOUSAF 
(screen  A-2 ) . 


\7 


_ SCREEN  A-2  | _ 

TAC  FLEET  STATUS 

DEPLOYMENT  PLANNER 


lil 


samm 


■  V»»»T[.  >!.«—> 


DAYS  LEFT 
BASE  SUPPORT 
SORTIE  RATE (PER  DAY) 
DURATION (DAY) 
AIRCRAFT  TYPE 
NUMBER 

ELIGIBLE  BASES 
CALCULATE  SPARES 


Figure  31  Survey  Module  QH 
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DISPLAY  SYSTEM  A  (CONTINUED) 

The  AMS  PLANNER  recomnends  the  Best  aircraft  to  support  the 
oeoloyment  (screen  A-3).  The  engines  installed  in  the  aircraft 
have  nigh  health  ratings.  The  AMS  PLANNER  -econmenes  four  spare 
engines  ane  identifies  their  location. 


SCREEN 


TAC  FLEET  STATUS 

DEPLOYMENT  PLANNER  ,.8. 


numbers 
(S/N) 
indica te 
you  must 
install 
the  spar* 


A/C 

BASE 

L  S'N 

R 

124 

CUTsT 

p~m 

Pi  77 

159 

LUKE 

P  1 46 

P 194 

172 

LUKE 

P21 1 

3333 

201 

LUKE 

PI  17 

P 1 33 

1  92' 

LANG 

P142 

P 1  52 

2C3 

LANG 

P322 

P404 

21 1 

LANG 

P4  1 1 

P362 

233 

LANG 

P507 

P333 

251 

LANG 

P  1 72 

P 1 25 

262 

LANG 

SEES 

PI  79 

4  ENGINES  REQUIRED  TO 
SUPPORT  DEPLOYMENT. 

S/N  BASE  LOC  STATUS 

F706  LUKE  SHOP  SERV 

P 1 59  LUKE  162R  SERV 

P244  LUKE  SHOP  SERV 

P272  LANG  SHOP  SERV 


fsTOp') 


PLEASE  ANSWER  THESE  QUESTIONS  BEFORE  PROCEEDING 


Screen  A-3  snows  only  the  tail  numbers,  serial'  numbers,  and  locations  of 
the  recommended  engines  and  aircraft.  Is  there  additional  information 
you  would  require? 


Rate  the  effectiveness  of  using  an  AMS  interactive  program  to  plan  deploy¬ 
ments. 


very 

valuable 

strongly 

approve 


worthless 

strongly 

disapprove 


Is  there  additional  information  that  should  be  requested  from  the  user  on 
screens  A-l  and  A-??  If  so,  write  these  items  on  screen  A-l. 

Comment  on  Display  System  A: 


Figure  32  Survey  Module  QI  PROCEED  TO  NEXT  PAGE  ^ 


DISPLAY  SYSTEM  ? 


You  request  the  e-toc.iiec  management  system  (AKS)  to  provide  the  TACTICAL 

MENT  PLANNER.  Screen  B-1  appears  on  vour  vioeo  terminal.  The  PLANNER 
Is  user-interactive.  You  must  specify  information  concerning  the  deployment.. 


Figure  33  Survey  Module  QI 
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DISPLAY  SYSTEM  B  (CONTINUED) 


Hign- 

UghteS 

engine 

serial 

numbers 

(S/N) 

indicate 

you  must 

install 

tnat 

spare. 


The  AMS  PLANNER  recommends  the  best  aircraft  to  support  the 
oeployment  (screen  B-3).  JOINT  SPA  is  the  average  of  the  indi¬ 
vidual  engine's  health  rating.  Current  trim  adjustment  (a TIT 
in  clicks  remaining)  anc  engine  operating  time  (EOT)  are  supplied 
for  each  recommended  engine. 


r 


SCREEN  B-3 


TAC  FLEET  STATUS 

DEPLOYMENT  PLANNER 


bsoddddN 


A^C 

BASE 

LUXE 

S^N 

L  R 

JOINT  ATIT 
GPA  L  R 

EOT 

_L _ R 

TT4 

PIT* 

PITT 

98  .2 

IS 

It 

m.s 

Ml  .3 

15? 

LUKE 

»IM 

PI  *4 

96  .4 

• 

11 

ni4 

SM.I 

172 

LUKE 

P*ll 

BB 

97.4 

II 

tl 

«ai.» 

Ml  .3 

281 

LUKE 

put 

PUS 

95.3 

1 1 

1 

V9C.I 

Ml. 3 

192 

LANS 

PHI 

PICS 

97.2 

11 

9 

411.1 

VB1 .3 

283 

LANG 

RMI 

M*4 

96.3 

IS 

IV 

m.f 

til. 3 

211 

LANG 

MU 

PMI 

98.1 

II 

t 

W  .1 

Ml  .1 

233 

LANG 

PWT 

MM 

96.4 

» 

• 

IM.l 

«*l  .3 

251 

LANG 

•in 

Pltf 

95.3 

♦ 

IV 

Ml  .3 

»4  4 

262 

LANG 

ra 

pm 

97.8 

II 

tv 

Ml.f 

m.i 

L»»T  UWWTt:  UK 


The  AMS  PLANNER  recommends  four  spares.  SPA  is  the  measure  of 
engine's  health  and  performance. 


SCREEN  B-« 


TAC  FLEET  STATUS 

DEPLOYMENT  PLRNNER 

0 - 


mv  rr'u-ntm 


4  REQUIRED  TO  SUPPORT  DEPLOYMENT 


S/N 

Pi  86 

BASE 

LWT 

LOC 

SEffP 

STATUS 

W 

CPA 

9F7? 

“W- 

iff.. 

P 1 59 

LUKE 

162R 

SERV 

87  .8 

12 

422.6 

P244 

LUKE 

SHOP 

SERV 

98 .1 

18 

391  .3 

P272 

LANG 

SHOP 

SERV 

97  .3 

9 

383.9 

Figure  34  Survey  Module  QI 
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PLEASE  ANSWER  THESE  QUESTIONS  BEFORE  PROCEEDING. 


(stop) 


1.  Screens  B-3  and  B-4  provide  additional  information  (engine  health,  trim 
status,  and  engine  operating  time).  Does  this  information  affect  the 
effectiveness  of  the  AMS  Deployment  Planner? 

greatly  greatly 

increase  _ :  :  : _ :  decrease 

2.  Evaluate  the  desirability  of  having  the  Deployment  Planner  calculate  the 
spare  engine  requirements. 


very 

valuable  :  : 

:  :  worthless 

strongly 

strongly 

approve  :  : 

:  :  disapprove 

3.  Comment  on  Display  System  B: 


t . 


i 


1 


Figure  35  Survey  Module  QI 
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3.12  QJ-TCTO  Assessment 
Scenario : 

As  MAC  engine  manager,  you  have  the  responsibility  for 

determining  the  impact  on  support  operations  and  readiness  of  a 
proposed  TCTO  for  the  TF33P7  engine  series.  The  TCTO  would 
require  the  placement  of  the  third-stage  disc  at  6000  cycles. 

The  swapout  procedure  would  be  performed  at  the  base  unless 
the  engine  is  slated  for  depot  repair  at  or  near  the  6000 
cycle  limit.  How  many  engines  currently  at  the  depot  are 
eligible  for  modification?  Based  on  MAC’S  programmed  flying 
hours,  how  many  engines  will  reach  the  6000  cycle  limit  over 
the  next  six  months  (overall  and  by  base)? 

Scenario  Objective: 

This  scenario  requires  the  function  of  sorting  all  TF33P7 
engines  on  location  (depot)  and  cycle  distribution.  A  forecasting 
function  would  be  used  to  predict  the  number  of  engines  reaching 
the  6000  limit  in  the  six  month  planning  horizon. 

Display  Formulation: 

The  TCTO  assessment  scenario  is  accompanied  by  display 
system  A  and  B,  (Figure  3  6,  3  7,  3  8,  and  3  9).  Display  system  A 
contains  two  screens  of  information;  system  B  contains  3.  Table 
15  summarizes  display  density,  format  and  special  techniques. 

Table  15 

Module  QJ  Display  Formulation 


SCREEN  1 
SCREEN  2 
SCREEN  3 


SYSTEM  A 

SYSTEM  B 

High  Density;  Tabular 

Meduim  Density;  Tabular 

Low  Density;  Graphical 

Low  Density;  Graphical 

Low  Density;  Graphical 

B  -  6  7 


Analysis : 


The  depot  report  on  the  TF33P7  provides  the  distribution 
of  engines  by  accumulated  cycles.  The  participant  compares 
tabular  and  graphical  displays  and  evaluates  their  effective¬ 
ness.  He  also  rates  the  criticality  of  providing  additional 
information  concerning  an  engine's  location  in  the  repair  process. 
The  participant  identifies  a  requirement  for  additional  in¬ 
formation  he  would  require  before  specifying  which  engines 
at  the  depot  qualify  for  disc  swapout. 

Based  on  programmed  flying  hours  the  user  accesses  a 
forecast  of  the  engines  scheduled  to  reach  the  proposed 
6000  cycle  limit  over  the  next  months.  The  paticipant 
evaluates  the  tabular  and  graphical  options  for  displaying 
this  information  command-wide  and  at  the  individual  bases. 


display  system  a 


you  request  your  automated  management  system  (AMS)  to  provide  cycle  grouping  of 
All  TF33P7  engines  at  the  depot.  Screen  A-1  appears  on  your  video  terminal.  It 
aAmta  th*  number  of  engines  in  Men  eye)*  interval.  A-1  also  groups  th*  nixnber 
of  *ngi  n*t  in  Men  cattgory  that  ar*  in  transit  to  th*  Mpot  (TRANSIT) ,  awaiting 
maintenance  <Aa#a) ,  in  work  (KAINT),  or  awaiting  shipment  to  a  has*  (SHIPPING). 


r 


SCREEN  A-1 


SSB_L 


ENGINE  FLEET  STATUS 

TF33  ENGINE 


"TT33PT 


;n  1  i  v  i  ) 


ACjeamat. 


CYCLES 

8-4000 

NUM 

TRANSIT 

AUM 

MAI  NT 

SHIPPING 

~b~ 

~ B - 

~r 

0 

8“ 

4000-4680 

3 

1 

0 

1 

1 

4500-6000 

8  ! 

3 

2 

2 

1 

5000-5500 

12 

1 

5 

5 

1 

5500-6000 

13 

2 

6 

4 

l 

OVER  6000 

TCTfiT 

2  1 
SB 

0 

1 

0 

1 

r<C1tU'».WW 


Tha  system 
r*ou«st  is 
r*p*at*e 
for  rtf- 
trance 


You  n«<  request  tha  AMS  to  forecast  th*  number  of  TF33P7  anginas 
that  will  reach  6000  cycles  over  the  next  six  icnths.  Scraan 
h-Z  topaars. 


SCREEN  B-2 


ENGINE  FLEET  STATUS 

TF33  ENGINE 


sanan 


- 

T rSSPT? 

FORECAST  i 

ENGINES  > 

6000 

CYCLES 

BASE 

JULY 

AUG  SEPT 

OCT 

NOV 

DEC 

BOLLING 

3 

5 

5 

7 

5 

5 

CHRLSTON 

5 

7 

6 

1 1 

9 

7 

DOVER 

7 

10 

9 

12 

12 

9 

MEMPHIS 

2 

< 

3 

5 

5 

5 

VAN  NUYS 

3 

4 

5 

4 

4 

5 

Tnt  svster 

TOTAL 

20 

38 

2e 

39 

35 

31 

rtoucst  ' : 

**tD*ittc 
for  • 

ON»t  Ml 

■fUClTrt.  rwtCWif»  a—  C  «  J 

Figure  36  Survey  Module  QJ 
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DISPLAY  SYSTEM  B 

You  request  your  AMS  to  provide  the  cycle  grouping  of  *11  TF33P7  engines  «t  tne 
deoot.  Screen  B-l  appears  an  vour  video  terminal.  It  tnews  the  number  of 
•n^nts  in  «*ch  eye  It  interval. 


SCREEN  B-l 


ENGINE  FLEET  STATUS 

TF33  ENGINE 


The  system 
request  is 
repeated 
for  ref¬ 
erence. 


You  not*  request  the  AMS  to  forecast  the  number  of  TF23P7  engines 
that  are  scheduled  to  reach  6000  cycles  over  the  next  six  months. 
The  forecast  for  the  entire  fleet  appears  on  the  left  side  of 
the  video  terminal  (screen  B-Z). 


SCREEN  B-2 


ENCIHE  FLEET  STATUS 

TF33  ENGINE 

rm CMC  I  MCI  >  MM  CYCLE* 


Figure  38  Survey  Module  QJ 
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*ou  nay  -eouest  tnt  forecast  for  eecr>  Date  ooeratmc  Tr23»7 


SCREEN  B-3 


ENGINE  TtEET  STATUS 

TF33  ENGINE 


DOVER  ARE 


aanaar 


»*eoues:  is 
'•trainee 
for  ref¬ 
erence. 


(stop] 


PLEASE  ANSWER  THESE  QUESTIONS  BEFORE  PROCEEDING. 


1.  Rate  the  effectiveness  of  graphing  the  cycle  interval  information  for  the 
engines  at  the  depot. 


very 

effective 


ineffective 


2.  How  would  the  screen's  effectiveness  change  if  the  right  siu*  of  screen 
B-l  included  information  on  the  engines’  location  in  the  repair  process 
(in  TRANSIT,  AWM,  etc.)? 


greatly 

increase 


greatly 

decrease 


3.  How  valuable  is  the  bar  graph  representation  used  to  display  the  numbers 
of  the  engine  in  screens  B-2  and  B-3? 


extremely 

beneficial 


i£.  Comment  on  Display  System  3: 


:  _  worthless 

I  don't  understand  it 


Figure  39  Survey  Module  Q.J  PROCEED  TO  NEXT  »AGE> 


.3,13  QK-Spare  Engine  Status 


Scenario : 

As  SAC  engine  manager,  it  is  your  duty  to  monitor  spare 
engine  status.  You  what  to  identify  bases  with: 

•  long  queues  of  engines  awaiting  maintenance 

•  high  rates  of  engines  that  are  not  mission  capable 
due  to  supply  (ENMCS) 

•  engines  assigned  to  maintenance  for  over  45  days 
You  can  access  an  automated  management  system  (AMS)  to  provide 
you  with  this  information. 

Scenario  Objective: 

This  scenario  illustrates  grouping  of  uninstalled  engine 
by  status,  command  wide.  On  a  daily  basis,  the  MAJCOM  engine 
manager  is  pi imarilv  interested  in  identifying  only  bases  that 
have  attributes  that  exceed  some  established  limit.  The  questions  are 
directed  towards  a  procedure  for  establishing  the  limits.  It  is 
also  important  to  identify  any  requirement  for  tracking  and  trend¬ 
ing  the  data  historically. 

Display  Formualtion: 

The  spare  engine  status  scenario  is  accompanied  by  display 
system  A  and  B,  (Figure  40  and  41).  Each  display  system  contains 
one  screen  of  information.  Table  16  summarizes  display  density, 
format,  and  special  techniques. 


Table  16 

Module  QK  Display  Formulation 


SYSTEM  A 

SYSTEM  B 

SCREEN  1 

High  Density;  Tabular 
Inverse  Video 

Medium  Density; 
Tabular;  Inverse 
Video;  Management 
By  Exception 

B  -  7  3 


Analysis : 


The  spare  engine  status  report  is  a  MAJCOM  level  display. 
Its  purpose  is  to  provide  the  MAJCOM  engine  manager  with  a 
snapshot  of  his  command's  repair  and  resupply  status.  He 
would  use  this  report  to  identify  bases  with  spare  engine 
problems  such  as  those  discussed  in  the  scenario.  The  survey 
evaluates  the  factors  the  engine  manager  needs  to  monitor. 

The  survey  paticipant  rates  the  alternative  for  managing 
the  engine  status  on  exception  and  discusses  the  formulation 
of  appropriate  "flags".  The  participant  indicates  the  value 
of  automatically  trending  certain  of  the  factors  (e.g.  ENMCS) 
for  a  user-specified  base  and  engine  TMS. 
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DISPLAY  SYSTEM  A 

You  rtduat:  your  automatad  urn^MM  tysta*  (AMS )  to  prpvida  tha  SAC  tpara 
angina  rtport.  Scraan  A-1  aopaars.  It  Mttt  SAC  basas  by  angina  typt,  mbdal , 
and  »«rltj  (TMS ) .  Tha  RATI  Is  tha  t  ratio  of  uninttallad  to  inttallad  anginas. 
Tha  nunear  of  atrvieaablt  anginas  art  Idantlflad  by  position  11,  2,  3.  or  a). 
A-1  displays  tha  numbar  of  anginas  in  maintananea  (KA1NT),  awaiting  naintanance 
(AWN),  and  not  oission  capablt  due  to  supply  (£I#1CS).  The  OVER  *5  category 
Identifies  a  "hangar  quaan"  In  tha  shop  for  over  45  days.  You  can  continue  to 
display  groups  of  bases  for  other  SAC  angina  TMS  by  a  simple  terminal  Input. 


SCREEN  A-1 


SRC  FLEET  MONITOR 

SPARE  ENGINE  STATUS 


urtf  »mti  nj 


Highlighted  areas  flag 
spares  problems. 

Haworth  AFB  has  10 
engines  down  due  to 
supply  and  2  hangar 
queans . 

OFTUIT  has  5  anginas 
down  for  supply. 


BASE  TYPE  RRT£ 
kISAwyr  TF'SS-3  m 

CRSTLE  TF33-3  12"< 

GRNOFKS TF33-3  1  A'. 

MINOT  TF33-3  16*< 

TOTAL 

KRBENR  TF33-5  m 


SHEMYfi 

TOTAL 


TF33-5 


MR  I  NT 
1 
2 


^STOPJ  PLEASE  ANSWER  THESE  QUESTIONS  BEFORE  PROCEEDING. 


1.  In  screen  A-1  the  bases  with  spare  engine  problems  are  highlighted.  Rate 
the  effectiveness  of  this  technique. 


very 

effective 


ineffective 


2.  Is  there  any  additional  information  you  would  want  displayed  for  those 
engines  classified  as  MAINT,  AWM,  or  ENMCS? 


Would  you  prefer  a  measure  other  than  the  ratio  S  of  uninstalled  to 
installed  engines  (spares  rate)  used  in  screen  A-1? 


4.  Comment  on  Display  System  A: 


Figure  40  Survey  Module  QK 
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DISPLAY  SYSTEM  B 


You  rtflutst  your  AMS  te  provldt  tM  SAC  spirt  tngln*  rpport.  Screw  B-l  ipptart. 
It  lists  only  those  Petes  with  en  engine  spares  problem.  As  of  OS  June  197$, 
four  bases  have  been  flagged  for  engine  management  attention.  The  specific 
problems  art  hlgnlignted  for  each  base. 


r 


SCREEN  8-1 


SAC  fleet  monitor 

SPARE  ENGINE  STATUS 


»wr  i _ oinnuuioiijtoiniu. 

THE  FOLLOWING  BASES  HAVE  &EEN  FLAGGED 


mmhii 


sffi  geifc  >«■—«« 


ENC  SERV 

BASE  TYPE  RATE  1234 
ETSBRTh  TT53-3  iV<  lBST 
OFFU1T  TF33-S  14‘d  2000 

DYESS  JS7-29  16"'.  0200 

ROBINS  JS7-43  15‘<  1102 


MAINT  AUM 

S—  ~7~ 
1  0 

3  § 

4  2 


ENHCS 

T 


OVER 

4S 


0 

0 

E 


Q  PLEASE  ANSWER  THESE  QUESTIONS  BEFORE  PROCEEDING, 


1.  In  Screen  B-l  only  the  bases  with  spare  engine  problems  are  displayed. 

Rate  the  effectiveness  of  this  technique. 

very 

effective _ :  _____  :  _ :  _ : _ ineffective 

2.  Discuss  how  to  develop  the  appropriate  factors  to  use  as  flags  in  System  B. 


3.  Suppose  the  AMS  supplied  System  B  as  a  daily  report  and  System  A  as  a 
weekly  report.  Rate  the  effectiveness  of  that  option. 

very 

effective _ ;  _  :  _ •  _ :  _ ineffective 

a.  Rate  the  benefits  of  the  capability  to  automatically  trend  over  time  the 
numbers  of  engines  that  are  ENMCS  for  a  particular  base  and  engine  TMS. 

j  very 

valuable  _ :  _  :  _ r  _ : _ worthless 

IS.  Comment  on  Display  System  B: 


Figure  41  Survey  Module  QK 
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APPENDIX  C 

ENGINE  MAINTENANCE  SUPPORT  SYSTEM  SURVEY  RESPONSES 


I.  INTRODUCTION 

This  section  accumulates  the  results  of  the  support 
system  survey.  In  Section  II  ,  responses  for  each  main¬ 
tenance  scenario  question  as  presented.  Analysis  of  the 
numerical  significance  of  the  returns  is  provided.  In 
addition  to  the  response  tallies,  comments  provided  by 
respondents  to  each  question  are  summarized.  In  Section 
III,  tallies  of  cumulative  issues  and  functional  capa¬ 
bility  evaluations  across  survey  scenarios  are  provided. 
Additional  analysis  describes  the  significance  of  the  results. 

Each  response  item  is  tabulated  with  the  response 
frequency  in  each  category  plotted  in  bargraph  form.  Sta¬ 
tistics  of  the  response  distribution  are  calculated  and 
may  provide  some  insight  into  the  interpretation  of  the 
response  significance.  The  factors  calculated  are  defined 
below. 

Define:  N  =  number  of  survey  responses 

x^  =  value  of  classification  (e.p.,  1,2, 3, 4,  or  5) 

1  N 

Then,  mean  response:  m  =  ^  Z  x ^ 

1  N 

Std .  Deviation:  s  =  E  fx.-m}2 

^i  =  l  1 

90%  Confidence:  Lgg  =  ±t  gg 

801  Confidence:  Lgg  =  ±t  gg  ^.^s 

where  t  is  the  Student's  t  distribution  value  with  power  > 
a ,  n 
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and  n  degrees  of  freedom.  The  significance  of  the  con¬ 
fidence  interval  is  that  the  probability  of  the  normal 
population  mean  lying  within  the  confidence  band  around 
the  sample  mean  is  the  power  of  the  test,  or 

Pr(m-L  <_  x  £  m+L)  =  y 

Caution  should  be  used  in  evaluating  classified  sta¬ 
tistical  hypothesis  test  results.  Statistical  measures 
do  provide  useful  quantification  of  an  otherwise  qualitative 
process . 

II.  SURVEY  RESULTS  ACCUMULATED  BY  SCENARIO 

The  following  section  presents  freqeuncy  tabulations 
of  survey  responses  by  question.  Survey  questions  and  ob¬ 
jectives  are  presented  in  other  sections  of  the  report. 

2 . 1  Question  A  -  Bare  Base  Deployment 

The  scenario  address  base  fleet  readiness  assessment 
for  deployment  to  an  unsupported  location.  System  A  contains 
less  dense  information  using  more  graphical  display  options. 

Figure  1  shows  the  system  ratings.  System  A  is  rated 
more  clear  than  System  B.  Both  systems  are  perceived  to 
have  sufficient  content  and  no  conclusion  can  be  reached  con¬ 
cerning  their  effectiveness  compared  to  existing  methods. 

Figure  2  presents  the  results  to  miscellaneous  questions. 
A  wide  spread  in  GPA  ranking  confidence  is  indicative  of 
uncertainty  concerning  either  its  meaning  or  effectiveness. 
Both  status  summaries  were  perceived  to  have  sufficient 
data  for  quick  assessment  of  base  readiness. 


C  -  2 


H*  CCMI  _J  rci  C£mT  _  fU  CCNT  _|  HI  CCWf 


NO. OF  RETURNS-  12. 
MEAN  RESPONSE-  2.33 
STD. DEVIATION-  1.1 

90  PCT  CONFID-+'-  2.0 
80  PCT  CONFID-+/-  1  .4 

1 .  -  Very  Cleer 
5.  -  Obscure 


NO. OF  RETURNS-  13. 
MEAN  RESPONSE-  3.08 
STD. DEVIATION-  1.0 
90  PCT  CONFID-+/'-  1  .8 
80  PCT  CONF I  D-+/'-  1  .3 

1 .  -  Very  Cleer 
5.  •  Obscure 


NUMB  OF  RESPONSES-  12 
MEAN  RESPONSE-  3.33 
STD .DEVIATION-  1.1 
90  PCT  CONFID-+/-  2.0 
80  PCT  CO NFID-+'-  1  .4 

1 .  -  Too  Much 

2.  -  enough 

5.  -  Too  Little 

NUMB  OF  RESPONSES-  13 
MEAN  RESPONSE-  3.38 
STD. DEVIATION-  .92 
90  PCT  CONFID-+/-  1  .? 
80  PCT  CONFID-+/-  1  .2 

1 .  -  Too  Much 

3.  -  Enough 

5.  -  Too  Little 


NUMB  OF  RESPONSES-  12 
MEAN  RESPONSE-  3.00 
STD. DEVIATION-  1.4 
90  PCT  CONFID-+/-  2.4 
88  PCT  CONFID-  +  .'-  1.8 

1 .  -  More  Effective 
3.  -  Seme 

5.  -  Less  Effective 

NUMB  OF  RESPONSES-  12 
MEAN  RESPONSE-  3.00 
STD .DEVIATION-  1.2 
90  PCT  CONFID-+/-  2.2 
80  PCT  CONFID-+/-  l .6 

1 .  -  More  Effective 
3.  •  Seme 

5.  •  Less  Effective 


Figure  1  Display  System  Rating  Response 
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NUMB  OF  RESPONSES3  13. 
MEAN  RESPONSE3  3.38 
STD. DEVIATION3  1.8 
90  PCT  CONFID-+/'-  3.3 
30  PCT  CONF I D=+/-  2.4 

1  .  -  Very  Valuabl e 

5.  -  Worthless 

6.  -  Unable  to  Score 


NO. OF  RETURNS*  13. 
MEAN  RESPONSE-  3.31 
STD  .DEVIATION3  .99 
90  PCT  CONF  I  D 1  .8 
80  PCT  CONF I D3  +  ^-  1  .3 
I  .  -  Too  Much 
J.  -  Enough 
5.  -  Too  Uttle 

NO. OF  RETURNS3  13. 
MEAN  RESPONSE-  3.38 
STD .DEVIATION3  .84 
90  PCT  CONFID-  +  /-  1  .5 
80  PCT  CONF I D=  +  /-  1  . 1 

l .  -  Too  ^uch 
3.  -  Enough 
5.  -  Too  Little 


Figure  3  presents  system  preference  responses.  System 
A  was  marginally  preferred  over  System  B  with  a  large  percent 
without  preference. 

Table  1  tabulates  comments.  System  A  status  summary  is 
preferred  with  the  high  density  ranking  displays.  Spares  rate 
rate  was  mentioned  as  a  candidate  for  elimination.  Task 
force  results  reinforced  both  comments. 

2 . 2  Question  B  -  Pilot  Squawk 

This  scenario  poses  a  diagnostic/troubleshoot ing  re¬ 
quirement  on  an  uninstalled  engine.  System  A  uses  tabular 
data  formats  while  System  B  employs  graphics.  Engine  profile 
A  has  low  density  summary  items.  Trending  capability  is  pro¬ 
vided  by  System  B  alone. 

Both  systems  (Figure  4)  were  rated  clear.  System  A 
was  judged  as  being  deficient  in  content  and  there  was  not  a 
consensus  concerning  its  effectiveness  against  existing 
methods.  The  addition  of  trending  capability  (System  B) 
increased  the  content  rating  and  it  significantly  improved 
the  perception  of  effectiveness  of  function.  This  conclusion 
is  reinforced  in  the  system  preferences  (Figure  51  which  shows  that 
the  addition  of  trending  is  perceived  to  be  valuable.  The 
responses  to  miscellaneous  questions  (Figure  b)  corroborate 
the  value  of  the  GPA  as  understood  and  used  against  the 
scenario  requirements. 

Other  question  responses  and  a  large  number  of  comments 
(Table  21  indicated  that  the  bargraph  representation  was  con¬ 
fusing  and  personnel  preferred  to  use  tabular  data.  The  use 
of  video  highlights  was  endorsed.  These  results  were  reflected 
in  task  force  commentary. 
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tQB  CLARITY  PREFERENCE 


w 


i 


NUMB  OF  RESPONSES*  13. 
MEAN  RESPONSE-  1 .62 
STD. DEVIATION*  .74 
90  PCT  CONFID-*/-  1  .3 
8®  PCT  CONFID*-*-'-  .96 


! 


QR  CONTENT  PREFERENCE 


NUMB  OF  RESPONSES*  13. 
MEAN  RESPONSE-  1 .62 
STD. DEVIATION-  .74 
90  PCT  CONFID-+/'-  1.3 
80  PCT  CONFID-+'-  .96 


NUMB  OF  RESPONSES-  13. 
MEAN  RESPONSE-  1  .62 
STD. DEVIATION-  .74 

90  PCT  CONFID-+/'-  1  .3 
80  PCT  CONFID**/'-  .96 


J 

f 


1 .  -  System  A 
Z.  -  System  B 
3.  -  No  Preftrtnc* 


i 


i 


Figure  3  Display  System  Preferences 
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Table  1 


Bare  Base  Deployment  -  Survey  Comments 


COMMENT 

FREQUENCY 

•  ENGINES  ARE  ONLY  A  SMALL  PART  OF 
DEPLOYMENT  DECISION  -  EVALUATE  ENGINES 
ONLY  IN  AIRCRAFT  QUALIFIED  TO  DEPLOY 

1 

•  PAST  PERFORMANCE  VERY  USEFUL  IN 

DEPLOYMENT  DECISIONS 

1 

•  ELIMINATE  SPARES  RATE  ON  BASE  SUMMARY 

4 

•  SHOW  %  COMPLETE  FOR  MAINT,  AWM,  ENMCS 
CATEGORIES 

1 

•  ADD  MORE  PIPELINE  SEGMENTS  TO  SUMMARY 

1 

•  DISPLAY  AIRCRAFT  HOLES 

1 

•  EXCEPTION  REPORTING  EXTREMELY  IMPORTANT 

1 

•  DISPLAY  SCHEDULED  MAINTENANCE  AS  A 

STATUS  MESSAGE 

1 

a  MAKE  COLUMN  CATEGORIES  APPLY  TO  ALL 

TYPES  ENGINES  (TF34  OOESN'T  COUNT 

CLICKS) 

1 

•  LIFE  LIMITS  IN  ENGINE  OPERATING  TIME 
REMAINING 

1 

•  SHOW  FT  IT  -  LAST  TRIM  VS  PRESENT 

1 

t  HST  MUST  RELATE  TO  CURRENT  HPT 

1 

•  SHOW  SOAP  TREND 

1 

•  A-SUMMARY  WITH  B-2/B-3 

4 

•  B-SUMMARY  with  A-2/A-3 

1 
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Gjp  CL  OR  ITY-OVERALL  (DO) 


UB  CLARITY-OVERALL  (DB) 


NO. OF  RETURNS*  20. 
MEAN  RESPONSE-  1 .70 
STD. DEVIATION-  .78 
90  PCT  CONr ID-*'-  1  .4 
80  PCT  CONF I  p-+v-  1  .0 

1.  -  Very  Clear 
S.  -  Obscure 


NO. OF  RETURNS-  21  . 
MEAN  RESPONSE-  1 .90 
STD. DEVIATION-  .97 
90  PCT  CONF  I D-+''-  1  .7 
80  PCT  CONFID-+/-  1 .3 

I .  -  Very  C leer 
5.  -  Obscure 


Qf  CONTENT-OVERALL  (DA) 


QB  COIjJ  ENT -OVERALL  J  DB  I 


EFFECT. -OVERALL (DA) 


.-OVERALL (DB) 


NO. OF  RETURNS-  21 . 
MEAN  RESPONSE-  3.57 
STD. DEVIATION-  .90 
90  PCT  CONFID-+/-  1 .6 
80  PCT  CONF  ID-*/'-  l  .2 

1 .  -  Too  much 
3.  -  fnouqh 
S  -  Too  t  1 tt  1e 

NO. OF  RETURNS-  20. 
MEAN  RESPONSE-  2.80 
STD. DEVIATION-  .93 
90  PCT  CONF I D-+/-  1 .7 
80  PCT  COHFI D-+/~  1 .2 

1 .  -  Too  Much 
3.  -  lr*ouqh 
5.  -  Too  little 


NO. OF  RETURNS-  21 . 
MEAN  RESPONSE-  2.48 
STD. DEVIATION-  1.2 
90  PCT  CONF  ID**''-  2.2 
80  PCT  CONF I D-*/-  I .6 

1  -  More  effective 

-  Came 

%  -  less  effective 

NO. OF  RETURNS-  20. 
MEAN  RESPONSE-  2.85 
STD. DEVIATION-  .91 
90  PCT  CONF  I  D-*-'-  1  .6 
80  PCT  CONFID-*/-  1 .2 

I  -  More  Effect Ive 
3  Same 

S  -  less  Effective 


Figure  4  Display  System  Rating  Response 
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HO. Or  RETURNS*  21  . 
HERN  RESPONSE-  1  .43 
STD .DEVIRT ION-  .49 
90  PCT  CONE  I D-  +  ''-  .09 
80  PCT  CONEID*-*-/-  .64 

t .  -  System  A 
2.  -  System  [i 
V  -  No  Preferrencp 

NO .OP  RETURNS*  21  . 
MERN  RESPONSE-  1.81 
STD .DEVIRT ION*  .39 
90  PCT  CONE  I D-  +  /-  .?1 
80  PCT  CONEID-  +  /'-  .51 

1 .  -  Sys  tern  A 

2.  -  System  8 

1.  -  No  Preferrence 


NO. OP  RETURNS*  21  . 
I1ERN  RESPONSE*  1.90 
STD . DEVIRT I  ON*  .53 
90  PCT  CONE  ID**'-  .95 
80  PCT  CONriD*^-  .68 

1 .  -  System  A 

2.  -  System  B 

3  -  No  Preferrence 


Figure  5  Display  System  Preferences 

C-9 


tea  ciat  I  act  ciMf 


NO. Or  RETURNS”  20. 
HERN  RESPONSE-  l .90 
STD .DEVIATION-  1.2 
90  PCT  CONflD-t-/'-  2.1 
00  PCT  CONFID-+/-  1  .5 

I .  -  Very  Effective 
S.  -  Ineffective 


NO. OF  RETURNS-  20. 
MEAN  RESPONSE-  2.35 
STD. DEVIATION-  1.5 
90  PCT  CONFID-*'-  2.7 
80  PCT  CONFID-+'-  2.0 

t .  -  Very  Helpful 

5.  -  Useless 

f.  -  Unable  to  Score 


NUMB  OF  RESPONSES-  21 
MEAN  RESPONSE-  1.43 
STD. DEVIATION-  .79 
90  PCT  CONFID-+'-  1  .4 
80  PCT  CONF I D-+-'-  1  .0 

1 .  -  More  Effective 
3.  -  Sane 

5.  •  less  Effective 

NUMB  OF  RESPONSES-  20 
MEAN  RESPONSE-  1  .65 
STD. DEVIATION-  .91 
90  PCT  CONFID-+/-  1 .6 
80  PCT  CONFID-f'-  1  .2 

1 .  -  System  A 

2.  -  System  B 

3.  -  lio  Preference 


Table  2 

QB  -  Pilot  Squawk  -  Survey  Comments 


COMMENT 

FREQUENCY 

•  FLAGGING  SYSTEM  IS  EXCELLENT 

2 

•  WOULD  LIKE  HARD  LIMIT  THRESHOLD  FOR  GPA 

1 

•  USE  TABULAR  GPA  SNAPSHOT  WITH  GPA  TREND 
(ELIMINATE  BAR-GRAPH) 

4 

•  WHAT  IS  AN  ACCEPTABLE  TREND? 

1 

•  TREND  SHOULD  HELP  WITH  LOCAL  FORECAST  OF 
REMOVALS 

2 

•  I  LIKE  TREND  INFORMATION  ON  GPA 

?. 

•  WHAT  WERE  ENGINE  CONDITIONS  AT  TIME  OF 
REPORTED  DISCREPANCY?  (N1 ,  N2,  ETC.) 

1 

•  WHAT  IS  THE  RATE  OF  HOT  SECTION  ACCRUAL? 

i 

•  ONLY  ONE  TREND  PER  GRAPH 

1 

•  THIS  INFORMATION  SHOULD  ALSO  BE  MADE 
AVAILABLE  TO  AGS  PEOPLE 

•  WHAT  MAINTENANCE  ACTION  IS  REQUIRED  TO 

GET  ENGINE  BACK  TO  100%  GPA 

9 

•  GRAPHS  MAY  CONFUSE  PERSONNEL  AT  WORKING 
LEVELS 

9 

C 

•  DISPLAYS  MUST  BE  KEPT  CURRENT  TO  BE  OF 

ANY  USE 

1 

•  LAST  BORESCOPE  STATUS? 

1 

t  USE  B-PROFILE  WITH  TABULAR  GPA  SNAPSHOT 

4 

t  USE  A-PROFILE  WITH  GPA  TREND 

2 

t  - 1  1 


Question  C  -  Engine  Alarm 


The  scenario  illustrates  troubleshooting  diagnostic 
procedures  for  an  off  idle  stall.  Management  by  exception, 
alarms,  indexing  and  data  access  are  illustrated.  System  A 
contains  a  low  density  tabular  format.  System  B  contains 
full  summary  data  items  on  profile. 

Figure  1  presents  the  system  rating  responses  which 
were  not  significantly  different  for  both  systems.  The  re- 
spondants  indicated  the  information  was  clear  and  approximately 
enough  was  provided.  There  was  a  range  of  opinions  concerning 
the  effectiveness,  which  provides  no  conclusions  in  this  regard 
Figure  8  shows  that  the  denser  profile  display  (B)  was  sig¬ 
nificantly  favored  with  regard  to  trend  effectiveness.  This 
is  underscored  by  the  large  number  of  comments  (Table  31 
suggesting  interchanging  Base  Summary  Status  products. 
Miscellaneous  question  responses  are  shown  in  Figure  ?. 

2 . 4  Question  D  -  TCTO  Management 


This  scenario  addresses  TCTO  Management  at  the  base 
level.  System  A  contains  high  density  tabular  formats  and 
svstem  B  uses  lower  density,  graphical  output.  System  C 
uses  low  density,  tabular  output  only. 

Figure  10  shows  the  display  ratings.  System  C  is  judged 
clear  in  interpretation.  All  systems  contain  enough  infor¬ 
mation.  Systems  A  and  C  are  rated  effective  in  addressing 
the  scenario  information  requirements. 

Figure  11  presents  the  results  to  miscellaneous  questions. 
Inverse  video  highlighting  was  deemed  an  effective  format.  Far 
graphs  are  marginally  clear.  Fife  limit  horizon  preference 
is  100  hours  which  is  consistent  with  task  force  comment-. 
SORTIN'!  capability  for  this  scenario  is  evtremelv  beneficial 
in  addressing  the  scenario  requirements. 


NO. OF  RETURNS-  18. 
MEAN  RESPONSE-  2.00 
STD .DEVIATION-  1.1 
90  PCT  CONFID-+/'-  2.0 
80  PCT  CONFID-*/-  1.4 

1 .  -  Very  Cleer 
5.  -  Obscure 


NO. OF  RETURNS-  18. 
MEAN  RESPONSE-  2.28 
STD. DEVIATION*  .99 

90  PCT  CONFIB-+/-  1  .8 
80  PCT  CONFID-+/-  1  .3 

1 .  -  Very  dear 
5.  -  Obscure 


NO. OF  RETURNS-  18. 
MEAN  RESPONSE-  3.28 
STD. DEVIATION-  .87 
90  PCT  CONFID-+/”-  1.6 
80  PCT  CONFID-+/-  1  .1 

'  .  -  Too  Hucn 
3.  -  Enough 
5.  -  Too  Little 

NO. OF  RETURNS-  17. 
MEAN  RESPONSE*  2.76 
STD.  DEV  I  AT  I  OH-  .55 
90  PCT  CONFID-+^-  .90 
80  PCT  CONFI D-+'-  .71 

l  .  -  Tqo  MUCt> 

3.  -  Enoua* 

5.  -  Too  Httl« 


NO. OF  RETURNS-  19. 
MEAN  RESPONSE-  2.68 
STD .DEVIATION-  1.1 
90  PCT  C0NFID-+'-  1  .9 
80  PCT  CONFID— 1  .4 

1 .  -  Hore  Effective 
3.  -  Seme 

5.  -  Less  Effective 

NO. OF  RETURNS*  18. 
MEAN  RESPONSE-  2.44 
STD. DEVIATION-  1.3 
90  PCT  CONF I D*+-/-  2.3 
80  PCT  CONFID-*-/'-  1  .6 

1 .  -  Hore  Effective 
3  -  Seme 

5.  -  Less  Effective 


Figure  7  Display  Svstem  Rating  Response 


r- 1.* 


NO. OF  RETURNS*  21 
MEAN  RESPONSE-  2. 
STD. DEVIATION* 

90  PCT  CONF I D=+/- 
80  PCT  CONFID=+/- 

1.  -  .'ter*  Effective 
3.  -  Sane 

5.  -  Less  Effective 


Figure  8  Display  System  Preferences 


Table  3 


QC  Engine  Alarm  -  Survey  Comments 


COMMENT 


FREQUENCY 


•  NEED  MORE  DIAGNOSTIC  INFORMATION 
PROFILE 

•  SINGLE  POINT  DIAGNOSTICS  ARE  ONLY 
MARGINALLY  ADEQUATE  -  NEED  TO  ACCESS 
TRENDS 

•  WHAT  ARE  POSSIBLE  CAUSES  OF  ALARM 
BESIDES  RCVV  (WHAT  ARE  THEIR 
PROBABILITIES?) 

•  INCLUDE  BORESCOPE  RESULTS  ON  PROFILE 

•  SHOW  NEXT  MAINTENANCE  ACTION  ON 
PROFILE  -  DISPLAY  LAST  ACTION  AS  WELL 

•  HST  MUST  RELATE  TO  CURRENT  HPT 

•  ALWAYS  SHOW  WHETHER  SENSORS  ARE 
OPERATING 

•  REMOVE  SPARES  RATE 

•  SHOW  %  COMPLETE  FOR  MAINT,  ENMCS , 

AWM  CATEGORIES 

•  PROVIDE  A  BASE  SUMMARY  WITH  B  PROFILE 


C- 1  5 


HO. OF  RETURNS3  19. 

ME OH  RESPONSE3  2.95 
STD. DEVIATION3  .60 
90  PC T  COHFID  =  +  /-  1  .  I 
80  PCT  CONFID3*'-  .79 

I  -Too  Much 
•  Inouqh 
.  loo  L’Mlp 


NO. OF  RETURNS3  18. 
MEAN  RESPONSE3  3.17 
STD.DEVIOTI ON3  .76 
90  PCT  CONE  I  D"  +  //-  1  .4 
80  PCT  CONF I  D=  +  /"-  .99 
1 ,  -  Too  Much 
3 .  -  E  nnugh 
h  -  Too  l i tt le 


NO. OF  RETURNS3  19. 
MEAN  RESPONSE-  1 .53 
STD .DEVIATION-  .68 
90  PCT  CONFID-+/'-  1  .2 
80  PCT  CONFID-+/-  .88 

1  .  -  More  Effective 

2.  -  Seme 

3.  -  Less  Effective 

NO. OF  RETURNS-  16. 
MEAN  RESPONSE-  2.13 
STD. DEVIATION-  .86 
90  PCT  CONFID-+X-  l  .5 
80  PCT  CONF I D-+x-  l  .  l 

3 .  -  More  Effective 
3.  -  Seme 

5.  -  Less  Effective 


NO. OF  RETURNS3  20. 
MEAN  RESPONSE3  1  .45 
STD. DEVIATION3  .74 

90  PCT  COHF I D-  +  "-  1  .3 
80  PCT  CONFID3*/-  .96 

1  •  Hours 

2  -  Per ceni 
t  ■  Both 


NO.^f  RETURNS3  20. 
MEAN  RESPONSE-  1  .‘‘0 
STD. DEVIATION 3  .97 

90  PCT  CONF I D-f/-  1  . 
80  PCT  CONF I D« ♦ / -  1  . 

1  Vrv  il'.dur 
c  tnpf  *r<  *  ^ 


NO, Or  RETURNS3  20. 
MEAN  RESPONSE-  3.05 
STD .DEV1AT  ION3  t  .9 
90  PCT  CONF  ID-**'-  3. 
80  PCT  CONF ID3*/-  2. 

1  -  Evil  rvnely  Essential 

y  .Worthless 
6  Unable  to  Vore 


7 

3 


4 

5 


Figure  9  Response  to  Miscellaneous  Questions 


C- 16 


QD  CLARITY-OVERALL  (DA) 


<JD  CLARITY-OVERALL  (DB) 


NO. OF  RETURNS*  10. 
MEAN  RESPONSE-  2.60 
STD. DEVIATION-  1.4 

90  PCT  CONFID-+/-  2.4 
80  PCT  CONF ID=+^-  1  .8 

1.  -  Very  Clear 
5.  -  Obscure 


NO. OF  RETURNS*  10. 
MEAN  RESPONSE-  2.80 
STD. DEVIATION-  1.2 

90  PCT  CONFID-+/'-  2.1 
80  PCT  CONFID**'-  1  .5 

! .  -  Very  Clear 
5.  -  Obscure 


QD  CLARITY-OVERALL  (DC) 


NO. OF  RETURNS*  10. 
MEAN  RESPONSE-  2.10 
STD. DEVIATION*  1.2 

90  PCT  CONFID-+/'-  2.2 
80  PCT  CONFID-+'-  1  .6 

1 .  -  Very  Clear 
5.  •  Obscure 


QD. CONTENT-OVERALL  (DA) 

■ 

I  i  J  *  * 

QP  dt)Nf ENT-OVERALL  (DB) 

•  1 

_ a 

m  m 

NO. OF  RETURNS*  10. 
MEAN  RESPONSE-  3.10 
STD. DEVIATION*  .83 
90  PCT  CQNFID-+/'-  1  .5 
88  PCT  CONFID— 1  .1 

1 .  -  Too  Huch 
3.  -  Enough 
5.  -  Too  Little 

NO. OF  RETURNS*  10. 
MEAN  RESPONSE-  3.10 
STD. DEVIATION*  .83 
90  PCT  CONFID-+/-  1  .5 
80  PCT  CONFID-+-'-  1  .1 

1 .  -  Too  Much 
3.  -  Enough 
5.  -  Too  Little 


Figure  10  Display  System  Rating  Response 
C  - 1  7 


rt«  ctm 


TCTO  MANAGEMENT 


I. 


NO. OF  RETURNS3  1 1  . 
MEAN  RESPONSE-  1.45 
STD  .  DEV  I  AT  I ON=  .66 
90  PCT  CONF I D=  +  /-  1 .2 
80  PCT  CONF I D=+/~  .85 

I  vnry  Effective  HtCHLIGHTS 
S  -  Ineffective  . 


NO. OF  RETURNS-  10. 
MEAN  RESPONSE-  3.00 
STD .DEVIATION-  1.0 
90  PCT  CONF  I  D=  +  </-  1 .8 
80  PCT  CONFID-+/-  1  .3 

1.  -  v>>ry  Clear  OARGRAPH 

S  •  Obscure  . . 


QD  LIFE  LIMIT  UNITS 


NO. OF  RETURNS-  1  1  . 
MEAN  RESPONSE-  2.00 
STD. DEVIATION-  1.2 
90  PCT  CONF  I  D=  +  //-  2.2 
80  PCT  CONF I D  =  +  /-  1  .6 

1  100  Muurs 

l  -  ?l>0  Mom  •> 

3.  -  l'oui|K>i»ent  Closest  to  Limit 
A  ■  No  Coniuent 


QD t A U T 0  SORT  PREFERENCE 


NO .OF  RETURNS-  1  1  . 

MEAN  RESPONSE-  1  .73 

STD. DEVIATION-  .86 
90  PCT  CONFID-  +  '-  1  .6 
80  PCT  CONFID-  +  /-  1  .  1 

1.  Extremely  beneflcia1 
5  Worthless 


Figure  11  Response  to  Miscellaneous  Questions 


C  -  1  9 


v>. 


Table  4  lists  the  survey  comments.  Bargraph  interpretation 
appears  to  be  troublesome.  The  use  of  generic  column  headings 
was  notably  favored. 

Figure  12  shows  the  preferences.  Systems  A  and  C  are 
nearly  equal  in  user  preference. 


This  scenario  addresses  the  utilization  of  performance 
analysis  to  evaluate  multiple  installed  engines.  The  display 
systems  illustrate  the  GROUP  capability  with  system  A  showing 
tabular  format  and  System  B  utilizing  graphical  capabilities. 

Figure  13  presents  system  ratings.  System  A  is  rated 
clear  with  sufficient  information  and  more  effective  than 
current  procedures.  System  B  is  rated  unclear.  There  is  no 
significant  conclusion  as  to  its  effectiveness.  These  results 
are  reaffirmed  in  the  system  preferences  (Figure  14)  where 
System  A  is  overwhelmingly  chosen. 

Figure  15  presents  the  results  of  miscellaneous  questions. 
Over  701  of  the  responses  evaluated  the  squadron  trends 
correctly.  There  was  a  significant  spread  in  rating  the 
graphical  format  of  display  B  indicating  a  general  uncer¬ 
tainty  about  it  utility.  The  results  of  questions  concerning 
System  B  should  be  discounted  because  of  the  lack  of  clarity 
in  format.  The  ease  and  speed  of  usage  of  the  GROUP  function 
were  rated  in  the  maximal  range  indicating  the  utility  of 
this  function  in  addressing  the  scenario.  Comments  are  listed 
in  Table  5 . 

2 . 6  Question  F  -  Base  Maintenance  Forecast 

The  scenario  addresses  base  level  forecasting  of  engine 
removals  for  usage  and  performance.  Tabular  usage  removal 


C-  20 


Table  4 

QD  -  TCTO  Management  -  User  Comments 

COMMENT  FREQUENCY 

•  LIFE  LIMIT  BAR  GRAPH  CONFUSING  4 

•  USE  GENERIC  INFORMATION  CATEGORIES  3 

•  WHEN  MUST  TCTO  BE  ACCOMPLISHED?  1 

•  WANT  LIFE  LIMITS  IN  ENGINE  OPERATING  2 

TIME  REMAINING 


LARITY  PREFERENCE 


SBC 


NO. OR  RETURNS3  10. 
MEAN  RESPONSE3  2.10 
STD. DEV  I  AT  I  ON  =  .94 

90  PCT  CONriD-  +  ^-  1  .? 
80  PCT  CONFID3*/-  1  .2 


NO. OP  RETURNS3  10. 
MEAN  RESPONSE3  2.10 
STD  .DEVIATIONS  .94 
90  PCT  CONE  ID-+/'-  1  .7 
80  PCT  CONF ID  =  +  '-  1  .2 


NO. OF  RETURNS3  ie. 
MEAN  RESPONSE-  2.10 
STD .DEVIATION3  .94 
90  PCT  CONEIP-  +  /-  1  .7 
80  PCT  CONEID3*/-  1  .2 


r 


I  j 


System 

Systc* 

System 


i 


figure  12  Display  System  Preference 


qE  CLARITY  OVERALL  (DA) 


NO. OF  RETURNS*  17. 
HERN  RESPONSE-  1  .94 
STD .DEVIATION-  .87 
90  PCT  CONFID-+/*-  1  .6 
80  PCT  CONFID*-*^-  1  .1 

1 .  -  Very  Clear 
S.  -  Obscure 


NO. OF  RETURNS*  17. 
MEAN  RESPONSE-  3.24 
STD. DEVIATION-  1.2 
90  PCT  CONFID-+/-  2.2 
80  PCT  CONFID-*'-  1.6 

1 .  -  Very  Clear 
5,  -  Obscure 


NO. OF  RETURNS*  16. 
MEAN  RESPONSE-  2.94 
STD. DEVIATION*  .90 
90  PCT  CONFID-+/'-  1  .6 
80  PCT  CONFID*-*v-  1  .2 

1  .  -  Too  Much 
3.  *  Enough 
5.  -  Too  Little 

NO. OF  RETURNS*  16. 
MEAN  RESPONSE-  3.25 
STD. DEVIATION*  .97 
90  PCT  CONFID-+/-  1  .7 
80  PCT  CONFID**/-  1  .3 

1  .  -  Too  Much 
3.  •  Enough 
5.  -  Too  Little 


EFFECTIVENESS  (DA) 


NO. OF  RETURNS*  16. 
MEAN  RESPONSE*  2.31 
STD .DEVIATION*  1.2 
90  PCT  CONFID-+'-  2.1 
80  PCT  CONFID-+/-  1  .5 

1 .  •  More  Effective 
3 .  -  Same 

5.  -  Less  Effective 

NO. OF  RETURNS*  16. 
MEAN  RESPONSE-  3.19 
STD. DEVIATION*  1.3 

90  PCT  CONFID-*'-  2.3 
80  PCT  CONFID**'-  1  .7 


1 .  -  Hore  Ef  fee  i  We 

3  -  Same 

5  •  Less  Effecllre 


Figure  13  Display  System  Rating  Response 


jr-  v-  1  i  *1  i>ii 

■■■'  ■ . •  -  ■  -  . . . 


NO. OF  RETURNS*  17. 
MEAN  RESPONSE-  1  .53 
STD. DEVIATION*  .73 
90  PCT  CONFID-*'-  1  .4 
80  PCT  CONFID-  +  /'-  l  .0 


NO. OF  RETURNS*  17. 
MEAN  RESPONSE-  1.18 
STD .DEVIATION*  .51 
90  PCT  CONF I D .92 
80  PCT  C0NF1D=+'-  .67 


NO. OF  RETURNS*  17. 
MEAN  RESPONSE-  1  .29 
STD  .DEVIATION*  .57 
90  PCT  CONFID-  +  '-  1  .0 
80  PCT  CONF I D*+^~  .74 


I’  re  f  e  r  one  os 


TRENDING  QUESTION  (DP 


QE  GRAPHICAL  CLARtfv  (DB 


NO. OF  RETURNS®  16. 
ItEfiM  RESPONSE-  1.25 
STD .DEVIRT ION®  .43 
90  PCT  CONFID-+/-  . 78 
80  PCT  CONFID®*/-  .66 

l  -  Cum  cl  l 

I«t  udn  ! 


NO. OF  RETURNS®  17. 
MEAN  RESPONSE®  3.53 
STD.DEVIPTION®  1.8 
90  PCT  CONF  I  D-  +  //  -  3.2 
80  PCT  CONFID®*/-  2.3 


*ery  L ledf 

Utl  HUM.' 

•indble  lo  Sio r«? 


t 


QE  MODULE  DISPLPY 


I. ..I 


QE  CORE  TTETOTT 


«  M. 

w 

m  «•. 


ol- 


NO. OF  RETURNS®  18. 
MEPN  RESPONSE-  3.11 
STD.DEVIPTION®  1.7 
90  PCT  CONF ID-*/-  3.1 
80  PCT  CONF 1 D®+/ -  2.2 

)  No  Additional  Moduli.*  tm‘fi  »»u 
J  All  MoUii  l  c  % 
i  ihidlile  to  i».o»v 
4  A*  ke‘juii't.*d 

NO. OF  RETURNS®  17. 
MEPN  RESPONSE-  1  .47 
STD.DEVIPTION®  .85 
90  PCT  CONF  ID®-*/-  1  .5 
80  PCT  CONF ID®*'-  1  .  1 

i  i-. 

.  t . 

]  N<»  All.Mff 


QE  USP6E  SPEED 


l  -l  ■ 


QE  USPCE  EHSE 


HO. OF  RETURNS®  16. 
MERM  RESPONSE®  1 .75 
STD.DEVIPTION®  .90 
90  PCT  CONF  1  D-  +  ''-  1  .6 
80  PCT  CONr IP-a/-  1  .2 

I  V»ry  :)uuk  !  , 

**  V*r  y  Slowly 


NO. OF  RETURNS®  1 1  . 
tIERN  RESPONSE-  1  .82 
STD.DEVIPTION*  1  .0 
98  PCT  CONr ID-*'-  1  .9 
80  PCT  CONF I D* ♦  1.3 

I  V*r  y  t  i  1  W 

With  r.iMi  ndfiiuii, 


Figure  15  Response  to  Miscellaneous  Questions 


COMMENT 


FREQUENCY 


•  TABULAR  DISPLAY  CONFUSING  -  TOOK  TOO  1 

LONG  TO  ANALYZE 

•  DON'T  UNDERSTAND  BAR  GRAPH  2 

t  PREFER  HAVING  THE  NUMBERS  LIKE  ON  1 

TABULAR  DISPLAY 

•  THERE  MAY  BE  FACTORS  OTHER  THAN  THE  1 

MISSION  CAUSING  DEGRADATION 

•  WHAT  ARE  THE  MODULE  OPERATING  HOURS  1 

(CAN  I  MAKE  ADDITIONAL  QUERIES?) 

•  IS  GPA  THE  BEST  INDEX  OF  FI 00  HEALTH?  I 


forecasts  are  provided  by  both  systems.  System  B  uses 
graphics  to  depict  performance  associated  forecasted  re¬ 
movals  . 

Figure  ?.6  shows  the  system  ratings.  System  A  is  rated 
as  clear  with  enough  information  and  more  effective  than 
current  procedures.  A  larger  uncertainty  was  expressed 
in  System  B  resulting  from  the  graphical  presentation. 
Figure  17  shows  that  this  uncertainty  is  manifested  by  a 
significant  preference  for  System  A.  Comments  listed  in 
Table  6  reinforce  confusion  concerning  the  bargraph  format. 

The  miscellaneous  question  responses  validate  the 
spread  in  perception  of  the  bargraph  effectiveness.  This 
response  can  be  explained  by  emphasizing  the  wide  disparity 
in  survey  participant  experience  and  exposure  to  graphical 
evaluation  products  of  this  type.  It  was  overwhelming ly 
asserted  that  this  functional  capability  is  important  to 
base  level  management. 

2.7  Question  G  -  OCM  Team 


The  secenario  explores  information  requirements  for  OCM 
depot  evaluation  of  required  maintenance  procedures.  A 
single  display  system  was  utilized  to  evaluate  the  capability 
that  indexed  data  offers  for  this  type  of  maintenance  procedure. 

The  ratings  shown  in  Figure  18  indicate  the  capabilities 
identified  in  the  system  are  clear,  contain  sufficient  data, 
and  are  more  effective  than  procedures  in  place. 

Figure  19  presents  the  responses  to  miscellaneous  questions. 
These  are  summarized  below: 

(11  Inverse  highlighting  is  rated  extremely  effective. 

(2)  Unlike  other  bargraph  representations,  GPA  snapshot 
bargraphs  are  rated  effective. 


HO. 0F  RETURNS’  15. 
HERN  RESPONSE’  1  .73 
STD .DEVIRT ION=  1.1 
96  PC  T  CONF  ID-*-'-  1  .9 
80  PC  T  CONFID  =  +  /~  1  .4 

)  Vf»>  y  f  1  P,lt 

S  lh*  r  «|t  ** 


NO. OP  RETURNS’  14. 
HERN  RESPONSE’  2.57 
STD. DEV  1 RT 1 ON  =  1.3 

90  PC T  CONFID’*''-  2.4 
80  PC T  CONF I D  =  +  /-  1  .8 

1  •jrr  v  i  1  #M  r 

V  flhcmro 


HO. OF  RETURNS’  15. 
HERN  RESPONSE’  3.27 
STD .DEVIATION’  .85 
90  PCT  CONF  I  D’  + I  .5 
80  PC T  C0NF1D=  +  '-  1  . 1 

!  .  Hu.  !> 

f  nouqh 

S  Tno  |  i  1 1  I  .• 

NO. OF  RETURNS’  14. 
HERN  RESPONSE’  3.21. 
STD. DEVIATION’  1.0 
90  PCT  CONF  ID"*''"  1  .8 
80  PCT  CONF ID  =  +  ' -  1  .3 

\  ■  Too  Mut  h 

S  f Hough 
*> .  Too  l  » 1 1 1  <* 


NO. OF  RETURNS’  13. 
HERN  RESPONSE’  2.31 
STD.  DEV  1 RT 1  OH’  .82 
90  PCT  CONF I D’  +  /-  1  .5 
80  PCT  CONF  I  D  =  +  ''-  1  .  1 

f  Mnr  p  f  I  fp<  f  tvp 
S  .  [I  'or  1 1  vp 


NO. OF  RETURNS’  12. 
HERN  RESPONSE’  3.08 
STD. DEVIATION’  1  .4 
90  PCT  CONFID’*-/'  2.4 
80  PCT  CONF  ID’-*--"  1  .8 

1  .  Mnr.  (  f  '•'<  »  ... 

T  'mmp 

^  !#»<.«.  f  f  •  Pt  1  1  vp 


OF  SCENARIO  IMPORTANCE 


QF  BAR  L-RAPH  EFFECT 
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NO. OF  RETURNS'  16. 
MEAN  RESPONSE'  1  .19 
STD .DEVIATION'  .39 
90  PCT  CONF I D=+^-  .70 
80  PCT  CONFID=+'-  .51 

1  -  Critical 

S.  IKelecr 


HO. OF  RETURNS'  16. 
MEAN  RESPONSE-  2.81 
STD .DEVIATION'  1.6 
90  PCT  CONFID'  +  r--  2.9 
80  PCT  CONFID=  +  ''-  2.1 

t  -  iery  Effective 
5.  •  Ineffective 
(>.  -  Unable  to  Score 


Figure  18 


Response  to  Miscellaneous  Questions 


C -  30 


HO. Or  RETURNS3  10. 
MEAN  RESPONSE3  1 .70 

STD . DEV  I R T I  ON3  .90 
90  PCT  CONE  I  D  =  +  ',~  1  .6 
80  PCT  CONFID3*/-  1  .2 

1  .  -  More  E  f  fpcti vp 
3  -  Samp 

S  -  Less  Effective 


QG  CLARITY  OVERALL 

•• 


••■4 


NO. or  RETURNS3  10. 
I1EAN  RESPONSE3  1  .40 
STD. DEVIATION3  .49 
90  PCT  CONFID3*'-  .88 
80  PCT  CONFID=+/-  .64 

I .  -  Very  Clear 
5  -  Ohar.ure 


NO. OF  RETURNS3  10. 
MEAN  RESPONSE3  3.20 
STD. DEVIATION3  .75 
90  PCT  CONF  I  D**  +  r'~  1  .3 
80  PCT  CONFID3  +  rr-  .97 

1  -  Too  Much 

3  -  Fnough 

S.  -  Too  Uttle 


Figure  19  Display  System  Rating  Response 
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Trending  GPA  results  are  viewed  as  helpful. 

Vibration  history  plots  are  perceived  as  very 
helpful. 

All  respondents  indicated  that  SOAP  results  are 
required  for  OCM. 

All  respondents  indicated  the  effectiveness  of 
SOAP  particulate  rate.  This  conclusion  was  not 
accepted  by  the  task  force. 

Maintenance  history  records  were  overwhelmingly 
believed  to  be  effective. 

Data  products  were  desired  in  graphics  and  hard  copy. 

There  is  no  clear  cut  preference  for  the  full  life 
usage  status  (0357)  over  screened  parts  replace¬ 
ment  products. 

The  entire  list  of  outstanding  TCTO’s  was  preferred. 
Comments  are  included  in  Table  7. 

2 . S  Question  H  -  Depot  Maintenance  Forecasts 

The  scenario  addresses  depot  return  forecasting  using 
usage  and  performance  records.  A  single  system  illustrates 
an  interactive  form  input  and  tabular  data  product. 

Figure  20  shows  that  the  system  was  rated  very  clear  but 
without  sufficient  information.  Significantly,  respondents 
perceived  the  system  to  be  more  effective  than  the  current 
procedure.  This  indicates  a  general  lack  of  confidence  by 
the  respondents  in  current  information  management  methods 
to  address  this  function.  Table  8  lists  the  comments.  A 
two  year  forecast  period  was  reenforced  by  the  task  force. 

Figure  21  shows  the  miscellaneous  question  responses, 
'•'onthly  forecasts  rated  as  extremely  valuable.  Accuracy  level 
preference  is  between  80'!.  and  90°.  Removal  cause  was 
selected  as  an  additional  data  item  by  a  majority  of  the 
respondent  s  . 
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Maintenance  Forecast  -  User  Survey 


COMMENT 

FREQUENCY 

•  PERFORMANCE  TRENDS  AND  ACCURATE 
PROGNOSTICATION  ARE  KEYS  TO  OCM 

1 

•  CONSIDER  ESTABLISHMENT  OF  WATCH 

STATUS  FOR  MONITORING  ENGINES  (IT 
SUPPORTS  FORECAST) 

3 

•  SHOW  BOTH  TIME/CYCLE  AND  FAILURE 
REMOVALS  ON  SAME  SCREEN  OR  CROSS- 
REFERENCE  THEM 

1 

•  BAR  GRAPH  CONFUSING  -  LESS  EFFECTIVE 

6 

•  PREFER  BAR  GRAPH 

I 

•  INCLUDE  FAILURE  REASONS 

1 

•  GPA  TREND  RATE  MORE  IMPORTANT  THAN 
DELTA 

1 

•  GIVE  EXPECTED  EOT  UNTIL  REMOVAL 

1 

•  HOW  WERE  GPA  FAILURE  PROJECTIONS 
DERIVED? 

1 

IS*  | 


QG  IV-PROFILE 


I  •• 


I. 

QG  BARGRAPH 


HO. OF  RE TtJRHS  =  10. 

(1ERN  RESPONSE”  1  .20 
STD  .DEVIATION*  .60 
90  PCT  CONF  1  D *=  +  /'-  1  . 1 
30  PCT  COMF I  D  =  +  /-  .78 

I .  -  Very  E  f  fee 1 1 ve 

S.  -  Ineffective  HIGHLIGHTS 


HO. OF  RETURNS”  10. 
HERN  RESPONSE-  1.80 
STD .DEVIATION”  1  .2 
90  PCT  CONFID-+'-  2.2 
80  PCT  CONF I D  =  +  ^-  1  .6 

I  •  Very  Effective 

S.  -  Ineffective  -pa 


NO. OF  RETURNS”  9. 
MEAN  RESPONSE”  1.6? 
STD. DEVIATION”  .82 
90  PCT  CONF I D  =  +  /~  1.5 
80  PCT  CONF I Q  =  +  s-  1  .  1 

1  -  Very  Helpful 

5  -  Useless 


NO. OF  RETURNS”  10. 
MEAN  RESPONSE-  1.20 
STD. DEVIATION”  .60 
90  PCT  CONFID-  +  /-  1  .1 
80  PCT  CONFID=+r-  .78 

1  -  -  Very  Helpfu l 
5.  -  Useless 


f 


QG  SOAP  REQUIRED 


NO. OF  RETURNS”  10. 
MEAN  RESPONSE-  1 .80 
STD  .DEVIATION”  0. 

90  PCT  CONF I P-+  h-0  . 
80  PCT  CONFID  =  +  /--0. 

I  •  Vf*ry  f  ss*n  f  1 A  1 
S  Not  Reo»»ired 


NO. OF  RETURNS”  10. 
MEAN  RESPONSE”  1.00 
STD  .DEVIATION”  0. 

90  PCT  CONF I D-+H-0 . 
80  PCT  CONFID*+/-0. 

1  Very  f  f f*t  1 1 ve 
S  Ineffective 


Figure  20  Response  to  Miscellaneous  Questions 
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QG  HISTORY  PLOT 


Jjn 


QG  HISTORY 


HO. OF  RETURNS3  1C 
MEAN  RESPONSE3  1 , 
STD  .  DEV  I  AT  I  OH3 
90  PC T  CONFID  =  +  /- 
80  PC T  CONFID  =  +  /~ 

I  -  Vpry  Effective 
5  lopf  fpc  t ivp 


HO. OF  RETURNS3  10. 
NEfiH  RESPONSE3  2.60 
STD  .DEVIRTION3  .80 
90  PCT  CONFID3^-  1  .4 
80  PCT  COMF1 D=+/-  1 .0 

1  CRT  Disp lily 

2  -  Manual  Hp<  nrds  Only 

.V  -  CRT  Display  4  Manual  ords 


QG  TIME  CYCLE 


— 


QG  TC  TO 


NO. OF  RETURNS3  IQ. 

MERH  RESPONSE3  2.10 

STD. DEVIATION3  1.1 
90  PCT  CONFID3*'-  2.0 
90  PCT  CONF I D=+/-  1 .5 

1  -  CRT  Display- Automatic  SdPPntnq 

2  -  CjJ$7  Products 

3.  -  CRT  Display  t.  r,337 

<1  -  r, 3 1 7  With  Vrppnp d  Coinpnnpnls  IV 

HO. OF  RETURNS3  10. 

MEAN  RESPONSE3  2.60 

STD. DEVIATION3  .80 
90  PCT  CONF  ID3*''-  1  .4 
80  PCT  CONF ID3*/-  1 .0 

\  .  -  Ent itp  list 

2  -  CRT  Display  of  SpIpcTpiI  TCTOs 

V  -  CRT  Display  of  Fntirp  list  With  IV 


Figure  20  Response  to  Miscellaneous  Questions  (Continued 
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NO .OF  RETURNS  =  1  1  . 

HERN  RESPONSE3  1.91 
STD. DEV  I RT I ON3  1.1 
90  PCT  CONFID*=  +  /~  1  .9 
90  PCT  COtlF  I  D  =  +  /-  1  .4 

)  .  -  Very  Clear 
5  -  ^bsrure 


NO. OF  RETURNS3  11. 
MERN  RESPONSE3  3.27 
STD. DEVIATION3  .75 
90  PCT  CONFIDE/-  1  .3 
30  PCT  CONFID=+/-  .97 

l  -  Too  Mur  h 
1.  -  Enouqh 
5 .  -  Too  little 


QH  EFFECT.  OVERRLL 


••■4 


NO. OF  RETURNS3  1  1  . 
MERN  RESPONSE3  1  .73 
STD.DEVIPTION3  .62 
90  PCT  CONFrD3  +  ^-  I  .  1 
80  PCT  CONF I D-+/-  .80 

1  -  More  Effective 

1  -  Same 

S  •  t  ps*;  Effective 


Figure  21  Display  Svsnm  Rati  n  Response 
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2 . 9  Question  I  -  Multiple  Base  Deployment 

This  scenario  addresses  command  level  requirements  for  a 
multiple  base,  short  term,  tactical  deployment.  Both  displays 
utilize  an  automated  form  type  entry.  Display  System  A  uses 
a  lower  density  format.  System  B  uses  paged  information  and 
includes  usage  and  performance  data  on  selected  engines. 

Figure  22  shows  the  rating  responses  for  each  system. 

The  format  of  display  system  A  was  rated  clear  but  lacked 
sufficient  information.  System  B  was  acceptable  in  clarity 
and  contained  sufficient  information.  Table  9  lists  the  comments 
from  respondents.  A  significant  portion  has  doubts  concerning 
the  validity  of  this  scenario;  hence,  interpretation  of  the 
functional  aspects  of  the  responses  are  not  possible. 

Figure  24  indicates  that  System  A  is  preferred  for  clarity 
but  the  information  content  is  less  preferrable  than  System  B. 

Figure  23  shows  the  results  of  the  questions  pertaining 
to  the  value  of  the  concept  and  the  acceptance  of  this  functional 
capability.  A  strongly  mixed  reaction  is  observed  indicating 
some  negative  preference  among  respondents  and  confusion  over 
methods  and  calculation  techniques.  The  task  force  indicated 
that  this  type  of  capability  would  be  useful  at  the  base 
level;  however,  maintanence  personnel  should  utilize  sorting 
capabilities  of  MIMS  to  screen  engines  for  deployment. 

2.10  Question  J  -  TCTO  Assessment 

This  scenario  addresses  command  level  management  of  TCTO 
impact  and  assessment  of  fleetwide  maintanence  requirements. 

Display  System  A  presents  tabular  grouping  formats  and  System 
B  uses  bargraphs. 

Both  systems  were  rated  in  almost  the  same  way  (Figure  251. 
Clarity  was  very  acceptable,  content  was  insufficient,  to  address  the 


PO  Cl#T 


NO. OF  RETURNS3  1  1  . 
MENU  RESPONSE*  1.36 
STD. DEVIATION*  .64 
90  PCT  CONFID=  +  /-  1  .2 
80  PCT  CONFID=+/-  .84 

I  -  (fttteuieiy  Valuable 
S  -  Worthless 


NO .OF  RETURNS*  1  1  . 

MEAN  RESPONSE*  1  .91 

STD .DEVIATION*  .7 9 

90  PCT  CONFID*  +  /~  1  .4 
80  PCT  CONF I D=+/-  1  .0 

I  -  Coi'iect  more  than  $01  of  the  time 
l.  -  Correct  more  than  80*  of  the  tune 
3  -  Correct  more  thdn  ?0X  of  the  time 


NO. OF  RETURNS*  S. 
MEAN  RESPONSE*  2.20 
STD. DEVIATION*  1.2 
90  PCT  CONFID-*'-  2.1 
80  PCT  CONF I V  =  */~  l  .5 

1 .  -  Louse  of  Fa  1 1  ore 

2.  -  TOT 

3  -  ICF 

4  -  TAMP 


Figure  22  Response  to  Miscellaneous  Questions 
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31  CLARITY  OVERALL  IDB) 


MO. OF  RETURNS3  9. 
I1EAM  RESPONSE3  1.39 
STD.PEVIATI OH=  .99 
90  PCT  CONFID»+/-  1 .8 
80  PCT  CONF I D=+y-  1 .3 

I  -  Very  H*ar 
|  5  -  Oh^Furp 


NO. OF  RETURNS3  8. 
MEAN  RESPONSE3  2.38 
STD. DEVI  AT  ION3  .99 

90  PCT  CONFID-  +  F-  1  .8 
80  PCT  COHFID3*/-  1  .3 

1  .  -  Very  Cl rar 
S  ■  Obscure 


NO. OF  RETURNS3  9. 
MEAN  RESPONSE3  3.?8 
STD. DEVIATION3  .29 
90  PCT  CONFID3-*-/-  1  .4 
80  PCT  CONF I D3*/-  1  .0 

I  Ton  Mur  tt 
7  [  nnijfjh 

r»  -  Too  little 


NO. OF  RETURNS3  8. 
MEAN  RESPONSE3  2.83 
STD -DEVIATION3  .86 
90  PCT  CONF ID3*"-  1  .5 
80  PCT  CONFID=  +  /-  1  . 1 

1  -  Ton  Much 

V  -  Ennuoh 
S.  Too  Little 


Q I  CONTENT  OVERALL  (DA) 
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Q I  EFFECTIVENESS  (DA) 
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Figure  23  Display  System 


NO. OF  RETURNS3  9. 
MEAN  RESPONSE3  2.22 
STD  .DEVIATION3  .9? 
90  PCT  CONF ID3*'-  1  .6 
80  PCT  CONF I D  =  +  ^~  I  .2 

l  Mnr r  fffp<t>v*» 

T  Sane 

S  -  l  «•'.<;  rt  <  v  p 

NO. OF  RETURNS 3  8. 

MEAN  RESPONSE3  2.38 
STD  .DEVIATION3  1  -2 
90  PCT  CONF  ID3*/'-  2.2 
80  PCT  CONF I V-*/ -  1 .6 

l  Morn  r  Mpi-  t  •  VP 
{  '  A'np 

S  In  fMprf  Ivc 
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CONTENT  PREFERENCE 


.1  EFFECT.  PREFERENCE' 


NO. OF  RETURNS*  10. 
HERN  RESPONSE*  1  .70 
STD . DEV  I RT I  ON*  .64 
90  PC  T  CONF  I  =  i  .2 
80  PCT  CONF I D=+/-  .83 


NO. OF  RETURNS*  10. 
NERN  RESPONSE*  1 .70 
STD . DEV  I RTI ON*  .64 

90  PCT  CONF I B  =  +  /-  1  .2 
80  PCT  CONF I D=+/~  .83 


NO. OF  RETURNS*  10. 
NERN  RESPONSE*  1  .50 
STD .DEVIATION*  .67 
90  PCT  CONFID*  +  «'-  1  .2 
80  PCT  CONF I D=+/-  .87 


‘ •  System  A  , 

2.  System  B 
3  */o  ^reference  [ 


Figure  24  Display  System  Preferences 
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HO. OF  RETURNS3  10. 
MEAN  RESPONSE-  2.40 
STD .DEVIATION*  1.4 
90  PCT  CONFID3*/-  2.6 
80  PCT  CONF I D  =  +  /-  1  .9 

1  -  Very  Valuable 

5  -  Worthless 


NO. OF  RETURNS3  10. 
MEAN  RESPONSE-  2.50 
STD . DEV  I  AT  I  ON3  1.4 
90  PCT  CONF  1 D-  +  /'-  2.6 
80  PCT  CONF I D  =  +  /-  1  .9 

1.  -  Strongly  Approve 
5.  -  Strongly  Disapprove 


NO. OF  RETURNS3  9. 
MEAN  RESPONSE3  2.33 
STD . DEV  I RT I ON=  1.1 
90  PCT  CONF  I D-  +  /"-  1  .9 
80  PCT  CONF I D3*/-  1  .4 

l  .  -  Very  Valuable 
V  -  Worthless 


NO. OF  RETURNS3  10. 
MERN  RESPONSE-  2.30 
STD .DEVIATION3  1.3 
90  PCT  CONF ID-*/-  2.3 
80  PCT  CONF I D  =  +  /~  1  .6 

1  -  Very  Valuable 

5.  -  Worthless 


NO. OF  RETURNS3  10. 
MEAN  RESPONSE-  2.30 
STD. DEVIATION3  1  .3 
90  PCT  CONFID-+/-  2.3 
80  PCT  CONF I D3*/-  1  .6 

1  .  -  Strongl y  Approvp 
$.  -  Strongly  Disapprove 


Figure  25  Response  to  Miscellaneous  Questions 
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scenario  and  effectiveness  preference  against  current  proce¬ 
dures  was  inconclusive.  Figure  26  shares  that  the  tabular 
presentation  (System  A)  was  more  preferrable  than  the 
graphical  (System  B1  ,  especially  in  the  amount  of  information 
presented  in  the  product. 

Responses  to  questions  are  shown  in  Figure  2~  and 
comments  in  Table  10.  Engine  location  in  the  pipeline  is 
rated  as  important.  Split  responses  in  the  value  of  graphics 
is  reflected  in  the  effectiveness  rating  for  the  graphical 
forecast.  One  comment  was  received  with  significant  frequency 
regarding  multiple  system  access  to  resolve  management  function. 
This  response  can  be  interpreted  as  negative  reaction  to 
systems  in  which  significant  user  cross  referrencing  is  required 
to  obtain  data  items  that  are  matched  to  a  particular  functional 
requi r eme.n  t  . 

2.11  Question  K  -  Spare  Engine  Status 

This  scenario  addresses  the  command  level  engine 
manager  requirement  to  monitor  spare  engine  status  at  a  number 
of  remote  operating  bases  in  a  timely  and  efficient  manner. 

Both  systems  present  the  same  tabular  data  format.  System  A 
uses  highlighting  of  data  and  System  B  uses  classical  exception 
management  procedures  to  flag  detected  anamolies. 

Both  svstens  (Figure  28!  were  rated  clearly  understandable. 
System  A  was  judged  more  effective  than  current  practices.  A 
significant  preference  appeared  in  rating  the  exception  capa¬ 
bility.  In  this  small  sample,  the  respondents  viewed  System  !•'■ 
as  having  insufficient  information;  however,  several  felt 
strongly  that  it  was  more  effective  than  current  practices. 

In  Figure  29,  System  A  was  preferred  over  svster  bv  respondent 

These  responses  indicate  that,  while  classical  exception 
management  procedures  c in  he  used  for  highlighting  problems. 


NO. Or  RETURNS3  10. 
MEAN  RESPOHSE=  1  .90 
STD  .DEVIRTION3  .94 
90  PCT  CONF I D  =  +  /-  1  .7 
80  PCT  COME  I D  =  +  /-  1  .2 

1  .  -  Very  Clear 
5.  -  Obscure 


NO. OF  RETURHS=  10. 
MERN  RESPOHSE=  2.50 
STD . DEV  I  RT  I ON=  1.4 
90  PCT  CONF I D=+/-  2.4 
80  PCT  CONF  I  D  =  -*-'-  1  .8 

]  _  .  Very  Clear 
5.  -  Obscure 


NO. OF  RETURNS3  10. 
MEPN  RESPONSE3  3.30 
STD . DEV  1 RT I ON3  .78 
90  PCT  CONF 1 D  =  +  /-  1  .4 
80  PCT  COnFID  =  +  /-  1  .0 

]  -  Too  Mijrh 

1.  -  ?.  nough 
6 .  T no  little 

HO. OF  RETURNS3  10. 
MEPN  RESPONSE3  3.80 
STD  . DEVIATION3  .75 
90  PCT  CONF  ID3*/'-  1  .3 
80  PCT  CONF I D  =  +  /-  .97 

1  -  Too  Muc  h 

1  -  foouqh 

S  -  Too  I.  i  tt  le 


NO. OF  RETURNS3  9. 
MEPN  RESPONSE3  2.22 
STD. DEVIATION3  1.3 
90  PCT  CONF I D=+^-  2.4 
80  PCT  CONFID  =  +  /-  1  .7 

J  'lor  r  hfPi  11.0 

*  r.  in. 

■  -  Ik; 

NO. Or  RETURNS3  9. 


NEON  RESPONSE3  2.78 


ISTE. DEVIATION?-  1.7 
|«0  PCT  CONF IP3*  2  .2 
j  80  PCT  CONF  I  U3*-'-  1.6 


'  ~  T 


NO .OF  RETURNS3  1  1  . 
MEAN  RESPONSE3  1  .45 
STD  .DEVIATION3  .50 
90  PCT  CONriD»+/-  .90 
80  PCT  CONFID=+/-  .55 


NO .OF  RETURNS3  1  1  . 
MEAN  RESPONSE3  1  .27 
STD .DEVIATION3  .62 
90  PCT  CONF I D  =  +  /-  1  .  1 
80  PCT  CONF I D3*/-  .80 


NO. OF  RETURNS3  11 
MEAN  RESPONSE3  1  . 
STD  .DEVIATION3 
90  PCT  CONFID3+/- 
80  PCT  CONF I D-+/- 


.  -  Systw  - 
Z.  -  System  " 

3.  -  No  erpfprence 


73 
75 
1  .3 
.97 


Figure  27 


Display  System  Preferences 


Table  8 


Maintenance  Forecast  -  Survey  Comments 


COMMENT 

FREQUENCY 

•  INCLUDE  PROBABLE  CAUSE  OF  FAILURE 

2 

f  PROBABILITY  OF  MODULE  RETURN  ONLY 

1 

•  REQUIRE  AT  LEAST  6  MONTH  PROJECTION 

1 

•  USE  AT  BASE  LEVEL  ALSO 

I 

•  LONGER  TERM  REMOVAL  FORECASTS  (2  YRS) 
REQUIRED  TO  SUPPORT  LOGISTICS  MODELS 
AND  PROCUREMENT  LEAD  TIME 

2 

_ 

(’  -  In 


Table  9 


Multiple  Base  Deployment 


COMMENT 


•  DEPLOYMENT  MAY  BE  VIABLE  AT  8ASE 
LEVEL  -  PROBABLY  NOT  USEFUL  AT 
COMMAND  LEVEL 

•  CAN  ALL  AIRCRAFT  AND  SPARES  COME  FROM 
ONE  BASE? 

•  CERTAIN  CONSTRAINTS  IMPOSED  BY 
DEPLOYMENT  REQUIREMENTS  AUTOMATICALLY 
ELIMINATE  SOME  AIRCRAFT  FAIL  NUMBERS 
(ENGINE  HEALTH  IS  NOT  THE  ONLY  FACTOR) 

•  REQUIRE  MORE  INFORMATION  TO  DO 
PLANNING  (TIME  FACTORS,  HOT  TIME, 
OUTSTANDING  TCTO'S) 

•  DISPLAY  INDIVIDUAL  GPA  NOT  JOINT 

•  PROVIDE  MORE  THAN  REQUIRED  AIRCRAFT 
FOR  SELECTION  PURPOSES 

•  CURIOUS  HOW  AIRCRAFT  ARE  AUTOMATICALLY 
SELECTED 

t  DON'T  PUT  AUTOMATICALLY  REPLACE 
ENGINE,  LET  THE  USER  DETERMINE  THAT 


Survey  Comments 


FREQUENCY 


2 

1 

2 


3 


1 

1 


1 


Table  10 


QJ  -  TCTO  Assessment  -  Survey  Comments 


COMMENT 

FREQUENCY 

•  8AR  GRAPH  A  VIABLE  HIGH  LEVEL  DISPLAY 

2 

•  ADDITIONAL  QUERIES  REQUIRED  TO  SOLVE 

ALL  MANAGEMENT  PROBLEMS 

4 

•  ACCESS  INFORMATION  ON  NEXT  SCHEDULED 
MAINTENANCE  ACTIONS  FOR  ENGINES  CLOSE 

TO  LIMIT 

1 

•  DOES  THE  DATA  BASE  INCLUDE  INFORMATION 
INTRANSIT  TO  DEPOT 

1 

•  CONCERN  WITH  FORECAST  LOGIC 

1 

C  -  4  8 


»c«  ci h t  I  ni  ccht 


KO. OF  RE  rUPMS=  9. 
MEAN  RESPONSE3  2.44 
STD . DEVIATION3  1.3 
90  PCT  CONFID3*/-  2.3 
80  PCT  CONFID=  +  /-  1  .6 

I  -  Critical 
S  -  Useless 


NO. OF  RETURNS3  10. 
MEAN  RESPONSE3  2.40 
STD. DEVIATION3  1.6 
90  PCT  COHF ID3*/-  2.3 
80  PCT  CONF I D=+/-  2.0 

I  -  Very  fffectuve 
S  Ineffective 


NO. OF  RETURNS3  10. 
MEAN  RESPONSE3  2.00 
STD. DEVIATION3  1.0 
90  PCT  CONFID-t'-  1  .8 
80  PCT  CONFID3*/-  1  .3 

1  -  Gieatly  Increase 

s  •  Greatly  Decrease 


NO. OF  RETURNS3  9. 
MEAN  RESPONSE3  2.44 
STD. DEVIATION3  1.4 
90  PCT  CONF  ID3*''-  2.6 
80  PCT  CONFID-  +  /-  1  .8 

l  -  Cutremely  Beneficial 
5  -  Worthless 


igure  28  Response  to  Miscellaneous  Questions 


»t«  cimr  j  ««  tint 


Q^CLQRITY  OVERALL  IDA) 


HO, OF  RETURNS®  7. 
MEAN  RESPONSE®  1 .5? 
STD .DEVIAT ION®  .73 
90  PCT  CONFID-  +  '-  1  .3 
80  PCT  CONFID®*'-  .95 

1  .  -  Very  O  ear 
S  -  Obscure 


NO. OP  RETURNS®  7. 
MEAN  RESPONSE®  2.14 
STD  .DEVIATION®  1.1 
90  PCT  CONFlD=+'~  2.0 
80  PCT  CONE  I V=+s~  1 .5 

1 .  -  Very  Clear 

S.  -  Obscure 


HO. Or  RETURNS®  7. 
MEAN  RESPONSE®  3.14 
STD. DEVIATION®  .99 
90  PCT  CONF  I  D=  +  ''~  1  .8 
80  PCT  CONF ID  =  +  /-  1  .3 

1  -  Too  Much 

J.  -  Enouqh 
S .  -  Too  I  i  tt  l  e 

HO. Or  RETURNS®  7. 
HERN  RESPONSE®  3.71 
STD .DEVIATION®  .70 
90  PCT  CONF I  D  =  +  -'-  1  .3 
80  PCT  CONF  I  D®  +  /•  -  .91 

\  -  Too  Mur  h 

3  F  nntioK 

*»  -  Too  little 


NO. OF  RETURNS®  7. 
MEAN  RESPONSE®  2.29 
STD -DEVIATION®  I  .4 
90  FCT  CONF  I  D  =  +  2.5 

80  PCT  CONF ID®*^-  l  .8 

|  Mi i r  ii  '  f  f  o.  t  i  vp 

1  i.iiro 

to*.',  f  T  f  m  t  1 

NO. OF  RETUFNS®  7. 
MEAN  RESPONSE®  2.88 
STD. DEVIATION®  1  .6 
90  PCT  CONF  I  D  =  + -  3.0 
80  PCT  CONF l D=+ ' -  2.1 

i  Mn r  e  (  f  fix  '  lv«> 

•  TV.  I  1  ( Pi  f  t  V  P 


Figure  29  Display  System  Rating  Response 


highlighting  and  summary  methods  may  be  more  acceptable  to 
the  management  personnel  because  there  is  no  perception  of 
missing  data.  These  responses  are  reinforced  by  miscellaneous 
question  responses  (Figure  30)  and  comments  in  Table  11. 

III.  CUMULATIVE  SURVEY  RESPONSES 

Survey  responses  to  data  item  categories  included  in 
several  questions  are  summarized  in  this  section.  Figures 
32-3-  present  these  results.  The  results  detailed  in  Chapter  III 
were  based  on  these  tallied  responses. 


1 


clarity  preference 


QK  CONTENT  PREFERENCE 


NO. OF  RETURNS*  8. 
MEAN  RESPONSE-  1  .50 
STD. DEVIATION-  .71 
90  PCT  CONFID**/'-  1  .3 
80  PCT  CONFID-+/-  .92 


NO. OF  RETURNS-  8. 
MEAN  RESPONSE-  1  .50 
STD .DEVIATION-  .71 
90  PCT  CONFID-  +  /-  1  .3 
80  PCT  CONFID-*/-  .92 


Table  11 


QK  -  Spare  Engine  Status  -  Survey  Comments 


COMMENT 

FREQUENCY 

•  DEFINE  ADDITIONAL  DISPLAYS  TO 

2 

IDENTIFY  THE  PARTS  PROBLEMS  FOR  ENMCS 

§  FURTHER  DEFINE  PIPELINE  SEGMENTS 

2 

•  DEFINE  EXCEPTION  REPORTING  LOGIC 

2 

BASED  ON  PIPELINE  STANDARDS 

•  ELIMINATE  %/REPLACE  WITH  AUTHORIZED 

4 

LEVEL  AND  NUMBER  ON  HAND 

•  ADD  %  COMPLETE  CLASSIFICATION 


NO. OF  RE  TURNS  =  8. 

MEAN  RESPONSE'  1.75 
STD .DEVIATION'  .66 
90  PC T  CONFID  =  +  ^-  1  .2 
80  PCT  CONE  I D  =  +  /-  .86 

1  -  Very  F  f fee  1 1  ve 

S  -  Inef  fee f  >  ve 


NO. OF  RETURNS'  8. 
MEAN  RESPONSE'  2.25 
STD. DEVIATION'  1.4 
90  PCT  CONFID-+/-  2.5 
80  PCT  CONE ID  =  +  /-  1  .8 

!  -  Very  fffective 

S  -  Ineffective 


NO. OF  RE  TURNS  =  8. 

MEAN  RESPONSE'  3.13 
STD .DEVIAT ION=  1  .3 
90  PCT  CONriD”+/~  2.3 
80  PCT  CONF I D  =  +  / -  1  .6 

l  .  Morn  F  f  f  r.  M  v e 
)  - 

A  .  toss  Fffo<tivo 

NO. OF  RETURNS'  7. 
MEAN  RESPONSE'  1  .29 
STD .DEVIATION'  .70 
90  PCT  CUNr  ID**-/-  1.3 
80  PCT  CONF I D=+ / -  .91 

I  -  Very  V.f  J  ;mM  « 

A  tfn»  thl  ps*. 


Figure  31  Response 


o  Miscellaneous  Quest  ion 


PROFILE  DENSITY 


NO. OF  RETURNS3  38. 
HERN  RESPONSE-  1  .45 
STD . DEV IRT  I ON3  .50 

90  PCT  CONFID-  +  /'-  .89 
80  PCT  CONFID-+'-  .65 

1.  -  Eatended  Version(High  Density) 

2.  -  Short  Version(Low  Density) 


NO. OF  RETURNS3  32. 
MEAN  RESPONSE3  3.09 
STD. DEVIATION3  .80 
90  PCT  CONFID-  +  /--  1  .4 
80  PCT  CONF I D=+^-  1  .0 

-  Too  Much 
3.  -Enough 
5. -  Too  Little 


NO. OF  RETURNS-  31. 
HERN  RESPONSE-  3.26 
STD.  DEVIATION3  .80 
90  PCT  CONFID-  +  /-  1  .4 
80  PCT  CONF I D=+s-  1  .0 

1 .  -  Too  much 
3.  -  Enough 
5.  -  Too  Little 


P  to  fill?  :witl  Status  l~ 
!'  r  c  -i'll  tat  inn  Res  pc ::  s 


F inure  a  2 


-uuvaa 


NO .OF  RETURNS3  31  . 
MEAN  RESPONSE3  1  .35 
STD .DEVIATION3  .74 
90  PC T  CONFID3*/-  1  .3 
80  PC T  CONFID  =  +  /-  .97 

1.  -  Very  Effective 
S.  -  Ineffective 


NO. OF  RETURNS3  20. 
MEAN  RESPONSE"  1  .40 
STD .DEVIATION3  .97 
90  PCT  CONFID3*/-  1  .7 
80  PCT  CONFID3*/-  1  .3 

1 .  -  Very  Effective 
S.  -  Ineffective 


NO. OF  RETURNS3  19. 

MEAN  RESPONSE3  1  .53 

STD .DEVIATION3  .68 
90  PCT  CONF I  D“  +  </-  1  .2 
80  PCT  CONF I D=+/-  .88 

1 .  -  Adequate 

2.  -  Inadequate 

3.  -  Unable  to  Sture 

NO. OF  RETURNS3  16. 

MEAN  RESPONSE3  2.13 

STD. DEVIATION3  .86 
90  PCT  CONFID-  +  /'-  1  .5 
80  PCT  CONFIDE-  1  .1 

1.  *  Very  Effective 
5.  -  Ineffective 


NO. OF  RETURNS3  26. 
MEAN  RESPONSE"  1 .19 
STD .DEVIATION3  .39 
90  PCT  CONFID*=  +  /-  .71 
80  PCT  CONF I D=+^-  .51 

1 .  -  Tabular  Preferred 
2  -  Bart^raph  Preferred 


NO. OF  RETURNS3  26. 
MEAN  RESPONSE-  3.15 
STD .DEVIATION3  1  .7 
90  PCT  CONF  I  D"  +  -'~  3.1 

80  PCT  CPNFin=t'-  2.2 

!  v r ,  t t tec  live 

■■  1  «>f  le.ti.i- 

I.  .  laDlr  t. 


V  uff 


►E*  cent 


NO. OF  RETURNS3  10. 

MEAN  RESPONSE3  1 .80 
STD .DEVIATION3  .40 
90  PCT  CONF I D=  +  ^~  .  ?2 
80  PCT  CONFID3*/-  .52 

1.  -  CRT  Display 

2.  -  CRT  Display  &  Manual  Records 


NO. OF  RETURNS3  10. 
MEAN  RESPONSE3  1  .20 
STD .DEVIATION3  .60 
90  PCT  CONF I D=  +  /-  1  . 1 
80  PCT  CONFID3+/-  .78 

1 .  -  Very  Useful 
5.  -  Useless 


NO. OF  RETURNS3  10. 
MEAN  RESPONSE-  1 .00 
STD. DEVIATION3  0. 

90  PCT  CONF  I  D-  +  r/-0  . 
30  PCT  CONFID3+/-0. 

1.  -  Very  Essential 
5.  -  Not  Required 


NO. OF  RETURNS3  10. 
MEAN  RESPONSE3  1  .00 
STD .DEVIATION3  0. 

90  PCT  CONF I D-  +  /-0  . 
80  PCT  CONF I D=+/-0 . 

1.  -  Very  Effective 
5.  -  Ineffective 


Figure  35  Integrated  Data  Source 
Fv a  1 ua  t i on 

C.  -  5 1! 


♦ 


Pdf  CENT 


TRIM  FACTOR  EVALUATION 


LIFE  LIMIT  UNITS  l CUM) 


NO. OF  RETURNS3  20. 
MEAN  RESPONSE-  3.05 
STD. DEVIATION3  1.9 
90  PCT  CONF I D-  +  /'-  3.4 
80  PCT  CONF I D=+/-  2.5 

1.  -  Extremely  Essential 

5.  -  Worthless 

6.  -  Unable  to  Score 


NO. OF  RETURNS3  22. 
MEAN  RESPONSE-  1 .82 
STD .DEVIATION3  1.1 
90  PCT  CONF I D-+/-  2.0 
80  PCT  CONF I D=+/~  1  .4 

1 .  -  100  Hours 

2.  -  Component  Closest  to  Limit 

3.  -  Flexible 

4. -50  Hours 


5.  -  200  Hours 


LIFE  USAGE 


NO. OF  RETURNS3  10. 
MEAN  RESPONSE3  2.38 
STD. DEVIATION3  1.1 
90  PCT  CONFID-+/--  2.0 
80  PCT  CONF I D=+/-  1  .4 

1.  -CRT  Display-Automatic  Screening 

2.  -G337  Products 


TCTO  STATUS 


T 


3.  -CRT  Display  &  G337 

4.  -G337  With  Screened  Components  IV 

NO. OF  RETURNS3  10. 

MEAN  RESPONSE3  2.60 

STD. DEVIATION3  .80 
90  PCT  CONF ID-  +  /-  1  .4 
30  PCT  CONFID3*/-  1  .0 

1.  -Entire  List 

2.  -CRT  Display  of  Selected  TCTOs 

3.  -CRT  Display  of  Entire  List  With  IV 


.flOT  TIME  FACTOR  (CUM) 


NO. OF  RETURNS3  50. 
MEAN  RESPONSE-  1 .42 
STD  .DEVIATION3  .70 
90  PCT  CONF  I D-+/'-  1  .3 
80  PCT  CONF  I  D  =  4v-  .<30 

1.  -  Hours 

2.  -  Percent 

3.  -  Both 


Figure  36  Life  Usage  Assessment 
Evaluation 

C-  59 


BASE  FOkECAS. 


I 


FORECAST  ACCURACY 


NO. Of  RETURNS 
MEAN  RESPONSE- 
STD. DEVIATIONS 
90  PCT  CONFID-'t-/' 
80  PCT  CONF I 

1  -  Critical 

5  -  Useless 


NO. OF  RETURNS= 
MEAN  RESPONSE- 
STD. DEVIATION- 
90  PCT  CONFID-+/ 
80  PCT  CONFID-+/ 

I.-  801 

mi 

3  -  951 
4-  1001 


^pEPQT  FORECAST  VALUE 


!  •• 


NO. OF  RETURNS- 
MEAN  RESPONSE- 
STD. DEVIATION- 
90  PCT  CONF I D=+^ 
80  PCT  CONFID-+/ 

-  Extremely  Valuable 

-  orthiesi 


NO. OF  RETURNS- 
MEAN  RESPONSE- 
STD. DEVIATION- 
90  PCT  CONFID-+/ 
80  PCT  CONFID-+/ 
1.  •  801 
2  -  901 

3.  -  No  Opinion 


JORECAST  D ISPLAY  PREF 


NO. OF  RETURNS- 
MEAN  RESPONSE- 
STD  .DEVIATION- 
90  PCT  CONFID-+/ 
80  PCT  CONF  I  D=-*-y 

1.  -  Tabular 

2.  -  Bargraph 


Figure  '  Forecast  1  valu.it  ion 


M' 


1  6  . 
1.19 
.39 

-  .70 

-  .51 


12. 

1  .67 
.94 

-  1  .7 

-  1  .2 


1  1  . 

1  .36 
.64 
-  1  .2 
-  .84 


1  1  - 
2.09 
.79 

-  1.4 

-  1  .0 


16. 

1  .44 
.61 
-  1.1 
-  .79 


APPENDIX  D 

TASK  FORCE  REVIEW  TRANSCRIPTS 


I.  INTRODUCTION 

A  critical  element  of  the  Phase  I  study  effort  was  the  task 
force  review  of  the  survey  results  and  the  prototype  system  re¬ 
quirements  definition.  This  meeting  was  held  at  Wright  -  Pat  ter  son 
Air  Force  Base,  Ohio,  on  6  -  June  1979.  Participants  in  the  task 
force  were  chosen  from  among  the  survey  respondents  and  from 
personal  interviews  as  a  cross  section  of  expertise  representing 
base,  depot,  MAJCOM,  and  AFLC  organisations.  This  appendix  pre¬ 
sents  edited  transcripts  from  that  meeting  which  include  critical 
commentary  and  insights  into  Air  Force  operational  information 
requirements . 

II.  ORGAN i CATION  OF  TRANSCRIPTS 

The  task  force  agenda  is  shown  in  Table  1.  The  survey  for¬ 
mats  and  scenarios  were  introduced  and  the  results  reviewed.  The 
displays  selected  during  the  survey  process  were  then  used  as  the 
basis  for  the  remaining  discussion.  The  objective  of  this  dialogue 
was  to  establish  a  consensus  of  opinion  on  data  requirements  and 
information  management  concepts  for  integration  of  automated  i'EMS - 
acquired  data  into  the  0 <\ S  process. 

The  discussions  were  wide  ranging  and  frank  concerning  the 
current  status  and  desirable  improvements.  The  edited  comments 
are  indexed  in  the  margin  according  to  requirement  and  topic  to 
facilitate  easy  reference.  The  column  indexes  are  correlat'd  t  o 
major  elements  of  the  requirement  definition  in  Table  7  and  cross- 
referenced  to  transcript  pagination  in  Table  a.  1  he  discussions 
in  the  transcript  cover  base  level  and  depot  information  requ  i  remen 


n- 1 


Table  1 

Task  Force  Review  AaenHa 


6  JUNE 

1979 

8:15 

Introduction 

8:30 

Task  Force  Objectives/Background 

8:45 

Summary  of  Survey  Results 

9:30 

System  Overview 

10:00 

Base  Level  Prototype  System  Capabilities 

1:00 

Depot  Prototype  System  Capabilities 

2:00 

Command  Level  Prototype  System 

Capabilities 

2:45 

Session  Review 

7  JUNE 

1979 

8:30 

Review  First  Session 

9:00 

Summary  of  Results 

9:30 

Presentation  Final  System  Design 

11:00 

Di scussion 

D-  2 
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TABLE  2 

Correlation  of  Major  Topics  I  I 

with  Index  Symbols  j 


!  CATEGORY/TOPICS 

1 

i  INDEX  'YMBOl 

1  SYSTEM  OVERVIEW 

i  i 

!  -  Introductory  Remarks 

In  i 

j  -  Goals  of  System 

Do 

1 

:  maintenance  management  process 

I  '  '  .  1 

j 

!  -  Management  Decision  Process 

Md  1 

1  -  Deployment 

1  De 

-  Qn-Condition  Maintenance 

Oc 

*  Opportunistic  Maintenance 

;  Cm 

i  ; 

exception  reporting 

i 

1  -  Oata  Alarms,  Exceptions 

'  A 1 

-  Management  Sy  Exception 

Me 

-  watch  Status 

WS 

DATA/ INFORMATION  ITEMS 


-  Diaonostic  Messages 

-  Historical  Oata  Reguirements 

-  Maintenance  History  Reguirements 

1  -  Gas  Path  Average 

•  life  Usage  Messages 
;  -  SOAP 

-  Supply  Considerations 

i  •  Tracking  Modules 

Dm 

i 

i  Hu 

Ga 

1  Lu 

1  So 

Su 

i  'k 

!  DATA  DISP'.AYS/FORMAT 

1 

;  -  8ase  Status  Summary 

3s 

-  Correlation 

1  Co 

-  Data  Format 

!  Df 

-  Engine  Profile 

i  Ep 

-  Forecast 

Fo 

i  -  Trending 

rr 

i 

DATA  ACCESS/ INQUIRY 

i 

i 

‘  -  Date  Access  Methods 

Da 

1  -  Grouping  CapaoiHtles 

Sr 

-  Renklng  Capabilities 

Pa 

SYSTEM  ARCHITECTURE 


-  System  Architecture 

Ar 

-  Base  Level  Processor  Requirements 

3* 

-  Depot  Requ'rmnents 

1  ?° 

-  Supply  Considerations  |  Su 


t  OATA  ACQUISITION/INFUT 

I 

-  Age  of  Data 

1  Ad 

-  8ase  Level  Reporting 

i  Br 

-  Flying  Schedule 

rS 

|  -  Maintenance  Schedullng/Reporttng 

Ms 

-  Sensor  Rel Ubl 1 1 ty/Accuracy 

St 

!  -  Comments  on  TENS 

1  _  _  _ 

•e 

D-  3 


a . 


I  n 


for  on-condition  maintenance  support.  Display  references  are 
included  as  figures. 


III.  PARTICIPANTS 


The  task  force  consisted  of  participants  with  extensive  and 
wide  ranging  experience  in  Air  Force  engine  maintenance,  support 
and  logistics  at  base,  depot,  command  and  AFLC  levels.  Table  4 
lists  the  symbols  used  to  key  speakers'  comments  arid  c  ros  s  -  re  fe  renc  e 
the  speakers'  expertise  and  organisation. 

IV.  TASK  FORCE  TRANSCRIPTS 

4 . 1  I nt  roduc  t ion 

M:  The  philosophy  of  using  displavs  as  a  means  for  specifying 

system  requirements  was  used  with  the  survey.  What  we  were  look¬ 
ing  for  with  the  displays  was  an  identification  of  user  require¬ 
ments;  based  on  these  user  requirements,  to  drive  the  specifica¬ 
tions  of  the  system  requirements.  Usually  when  systems  are  designed 
they  go  backwards,  i.e.  they  look  at  the  svstem  requirements  lir-t, 
then  they  force  those  into  the  user  requirements,  and  then  they 
generate  displays  of  information.  It  is  hoped  that  our  approach 
will  improve  the  final  output  from  an  automated  turbine  engine 
monitoring  system,  and  impact  the  implementation  of  the  system 
within  the  Air  Force  by  integrating  information  that  you'll  he 
giving  us  today  into  the  design  phase. 

One  of  the  first  concepts  in  automatically  acquiring  a  lire, 
quantity  of  performance  data  is  the  need  to  reduce  it  to  a  concise, 
usable  parameter.  One  approach  is  gas  path  analysis.  What  you 
want  is  the  output  of  the  system  to  be  consistent  with  how  the 
Air  Force  performs  maintenance  and  performs  logistics  anaivsis. 
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Looking  at  GPA,  you  realize  early  on  that  in  using  it  and  making 
it  a  viable  parameter  to  help  direct  the  maintenance,  you  have  to 
integrate  it  with  some  of  the  other  standard  factors  such  as  time, 
cycles,  SOAP,  vibration,  and  others.  To  ultimately  integrate  the 
system  you  need  a  well- developed  plan  so  that  it  can  be  implemented 
at  all  levels  in  the  Air  Force.  We're  looking  primarily  at  what 
information  is  needed,  who  is  the  user,  what  is  the  format, 
how  should  the  data  base  be  organized,  and  what  kind  of  access 
Df  the  user  will  have.  What  we  want  is  to  identify  those  pieces  of 
information  normally  needed  to  approach  certain  maintenance  de¬ 
cisions,  management  problems,  and  group  those  together  so  that 
the  access  is  easier  and  more  closely  aligned  with  the  decision 
processes . 

Al:  We've  been  talking  in  the  Air  Force  about  diagnostics  systems 
and  what  we’ve  really  focussed  on,  at  this  point,  is  running  hard¬ 
ware  on  engines.  I’d  like  to  submit  to  you  right  now  that  the 
A-10  system  and  the  EDS  system  are  not  diagnostic  systems.  A 
diagnostic  system  is  the  total  of  what  is  being  discussed;  and 
the  hardware  which  is  out  in  the  field  is  only  that  which  collects 
the  data,  but  all  the  rest  makes  it  a  diagnostic  system.  It’s 
Go  a  repository  of  information  which  feeds  back  information,  that's 
the  diagnostics.  And  we  don't  want  to  get  misled  by  any  con¬ 
tractor  or  by  any  person  that  the  A-10  system  is  a  diagnostic 
system;  it's  only  the  input  to  the  system.  So  we've  got  to  go  away 
from  here  with  the  idea  that  the  critical  ability  is  to  pass  this 
information  around  and  get  it  back  out  for  a  decision-maker  or 
to  aid  our  decision-making;  that's  the  diagnostic  system. 

Cl;  Diagnostics  includes  the  peop 1 e  who  make  the  decisions,  a 
repository  of  information,  the  whole  works. 

M;  There  are  a  number  of  important  questions  concerning  infor¬ 
mation  requirements.  How  much  information  can  one  person  reallv 
Df  look  at  and  understand?  What  information  should  be  in  the  pro 

file,  and  what  candidates  are  there  for  subsystem  summary”  Which 
should  contain  the  more  detailed  pieces  of  information'  Which 
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shouldn't  you  normally  access  unless  there  was  a  problem  or  a 
reason  for  looking  at  a  particular  area?  Another  aspect  is 
accuracy.  How  accurate  is  information  and  how  is  that  portrayed 
on  the  display.  Can  you  at  least  make  some  judgement,  put  some 
confidence  level  on  your  decision'.’  In  the  format  of  the  data, 
there  is  the  option  of  tabular  or  graphical.  There  is  trending 
information,  recent  trends,  long-term  trends,  display  as  a  time 
plot.  In  addition  to  displaying  trends,  should  the  system  also 
correlate  this  information  with  maintenance  history  to  give  a  better 
feel  for  why  these  trends  existed? 

We  will  discuss  the  organization  of  the  data  base  atiu  f no 
access  to  the  information,  to  identifv  what  functions  you  have 
for  interrogating  the  system,  how  you  access  the  data  and  obtain 
certain  pieces  of  information.  What  sort  of  interroga t i on  func¬ 
tions  should  be  available  in  each  different  level’’  Also,  the 
concept  of  management  by  exception.  A  lot  of  people  in  the 
.■■. ir  Force  feel  very  strongly  about  the  concept  of  management  by 
exception.  When  does  that  make  sense  as  a  means  of  displaying 
the  data.  Should  you  only  display  what  the  guy  needs  to  know 
about  a  particular  problem,  or  at  least  make  it  so  that  he  has 
to  specifically  ask  the  system  to  provide  him  with  certain 
pieces  of  information.  Age  of  data  is  driven  by  the  update 
interval  and  the  frequency  with  which  the  user  would  be  acces¬ 
sing  the  data.  This  drives  the  transfer  frequency;  how  often 
Jo  you  have  to  update  the  central  data  base;  what  portions  of 
the  information  need  to  be  transferred  immediately;  what  per 
tions  can  he  Je laved? 

I'll  be  discussing  two  items  that  were  purposely  left 
rather  tiutv  within  the  context  of  the  Phase  I  study.  These 
were  left  fuzzy  for  two  reasons:  thev  will  lie  dependent  somewhat 
up'-n  further  development  activity,  and  we  wanted  to  allow  mir- 
e 1 ves  enough  flexibility.  The  first  area  i s  the  spec  i  f ic  arch: 
fect'ii'’  M  the  hardware  at  the  base  level  which  will  he  imple¬ 
ment”.!  ;  n  tiie  1  ''*i*  system.  And  the  sec  mi  i  terns  is  this  ,t  . 

:  i  •  a  iver  age  ir.r’rter  which  we  have  ir'iitrar:  iv  let  1'iel  a 


being  undefined.  I'll  discuss  a  little  bit  about  how  we  can 
do  that. 

The  data  management  problem  within  the  comprehensive  engine 
management  system  is  significant.  Just  to  do  the  increments 
that  are  associated  with  parts  tracking  and  spares  allocation 
represents  a  significant  amount  of  data.  To  incorporate  diag¬ 
nostics  and  airborne  acquired  data  into  that  system  is  a  severe 
loading  factor  from  a  data  management  point  of  view.  Some  of 
Ar  the  issues  that  have  to  be  addressed  are  the  quantity  of  infor¬ 
mation,  the  age  of  data  requirement  at  each  level,  because  these 
are  strong  drivers  to  the  cost  and  the  hardware  requirements  to 
implement  a  distributed  processing  system. 

We've  chosen  to  leave  somewhat  undefined  the  hardware  at 
the  base.  There  are  two  concepts  of  the  hardware  at  the  base 
which  are  compatible  with  what  we're  talking  about  today.  This 
first  is  a  smart  ground  station,  or  a  shop  computer,  which  is 
used  to  record  engine  flight  data,  automatically  acquired,  to 
drive  an  interactive  terminal,  and  to  provide  data  products. 

Now  in  order  to  implement  this  with  the  displays  we're  talking 
about,  maintenance  information  has  to  be  input,  therefore,  the 
MMICS  computer,  the  base  level  computer,  would  have  to  be  tied 
in  with  a  two-way  direct  line.  The  MJ1ICS  computer  then  pro- 
Ba  vides  data  products  to  the  central  data  bank.  This  is  one 

configuration  of  the  system.  It  has  the  attractive  advantage 
from  a  hardware  point  of  view  that  the  bandwidth  or  the  time  to 
have  the  data  on  the  screen  is  much  faster  than  a  large  base 
level  computer  that  has  to  service  a  multiple  number  of  functions 
and  a  large  number  of  people. 

The  alternate  configuration  uses  a  somewhat  less  sophisti¬ 
cated  ground  station  to  record  data  and  to  transfer  it  via 
direct  digital  line  to  the  base  level  computer  within  which 
MMIihS  is  implemented.  The  base  level  computer  then  provides 
the  data  products  to  the  central  data  lank,  dr i ves  interactive 
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terminals  distributed  around  the  base,  and  produces  the  data 
products  which  incorporate  both  the  diagnostic  and  parts  infor¬ 
mation  and  so  forth. 

I  wanted  to  give  you  a  feel  for  what  we're  talking  about 
relative  to  the  computer  hardware  at  these  locations.  As  I 
said,  we're  flexible,  we've  specifically  left  these  items  un¬ 
defined  because  a  strict  and  rigorous  definition  at  this  point 
wasn't  necessary. 

The  second  item  is  the  gas  path  average.  This  is  a  diag¬ 
nostic  parameter  which  is  derived  from  thermodynamic  operating 
data  acquired  both  on  the  ground  and  in  flight,  and  processed 
through  a  fairly  sophisticated  computer  program  which  compares 
this  data  with  what  a  normal  engine  sees  and  what  has  been 
reported  on  that  engine  in  the  past.  What  we  have  chosen  is 
a  module- directed  gas  path  average  with  a  rather  loose  meaning. 

It's  consistent  with  the  capability  of  the  computer  to  produce 
this  type  of  diagnostic  parameter.  By  diagnostic  parameter  I 
mean  a  parameter  which  gives  you  an  indication  of  the  operating 
performance,  the  thermodynamic  compression  and  expansion  cap¬ 
ability,  and  indirect  measure  of  things  like  erosion,  foreign 
Ga  object  damage,  and  the  aging  of  the  material  components  within 
the  module.  But,  it  is  referenced  and  calculated  such  that 
a  100%  represents  the  nominal  or  new  performance  of  that  par¬ 
ticular  component,  and  0%  represents,  on  an  average,  what  an 
extremely  degraded  component  would  look  like.  The  critical 
item  here  is  that  there  cannot  be  a  threshold  associated  with 
this  parameter,  in  the  sense  that  you  cannot  absolutely  say 
that  a  gas  path  average  of  49  indicates  a  failed  module,  or  in 
the  case  of  an  engine,  a  failed  engine,  because  many  different 
failure  and  aging  modes  would  produce  the  same  gas  path  average. 

So,  to  summarize  what  the  gas  path  average  is,  it's  an 
indicator.  It's  a  diagnostic  in  the  sense  of  your  body  temperature 
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that  you  can  run  a  fevrer  and  not  be  sick.  But  if  you  don't  feel 
well  and  you  have  a  fever,  that’s  an  indication  that  something 
is  wrong. 

B3:  I  have  a  problem  with  this  whole  scenario  from  the  very 

start.  My  problem  was  getting  a  handle  on  the  sensors  and  the 
reliability  of  the  sensors.  Where  were  these  sensors,  how  would 
it  input  in  order  to  come  up  with  these  calculations  or  these 
trends  that  you're  developing?  Now  what  is  this  going  to  do 
to  the  guy  out  on  the  line  with  regards  to  maintaining  the 
sensors  that  are  going  to  develop  this  data  for  us? 

M:  In  the  sensor  complement  for  the  scenarios,  we  assume  for 

example,  in  the  F100,  it  was  the  EDS  sensor  complement.  In 
a  new  weapons  system,  a  new  engine,  for  example,  the  sensor 
complement  is  determined  precisely  as  a  trade-off  between  two 
factors.  One  factor  is  how  much  additional  information  can  I 
get  about  the  engine  by  putting  that  sensor  there?  And  how  much 
do  I  have  to  spend  in  terms  of  time  in  maintenance  activity  main 
taining  that  sensor  complement?  So  for  the  scenarios  we  had, 
with  the  EDS  for  example,  there  is  a  given  EDS  sensor  complement 
Se  We  use  that.  The  algorithm  produces  a  sensor  diagnostic  which 
shows  that  if  you  have  any  of  your  sensor  complement  fail,  it 
will  issue  a  message  saying  that,  for  example,  the  T2  probe 
has  failed  and  has  to  be  replaced.  This  is  available  in  the 
EDS  partially  at  the  flight  line.  It’s  available  after  the 
processing  of  the  downloaded  performance  data  has  been  done;  and 
that  would  then  come  out  in  this  type  of  display  environment. 

Now  you're  right,  it  has  to  be  a  trade-off  between  the  system 
analysis,  how  much  do  you  get  for  putting  more  equipment  on  the 
engine? 

B3:  Because  I  looked  at  our  test  cell  at  Kelly  AFB,  and  that 

thing  is  pretty  elaborately  instrumented.  But  the  PML  on  that  - 
we  have  a  tremendous  PML  workload  just  to  maintain  those  com¬ 
ponents  that  we  put  on  and  off  each  engine.  We  don't  leave  it 
on  the  engine.  Those  are  things  we  have  to  put  on  before  we, 
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in  other  words  prep  for  test,  that  have  to  be  removed  after  we 
test  it . 

M:  What  you're  saying  is  that  there  is  a  question  of  whether 

automated  engine  diagnostics  is  a  feasible  concept  in  the  sense 
that  you  have  to  put  on  sensors  and  maintain  them.  Quite  frankl 
the  answer  to  that  question  is  not  hard  and  fast.  There  are  no 
automated  engine  diagnostic  systems  in  the  field.  Now  the  IE  CMS 
is  being  flight  tested,  and  very  detailed  measurements  are  being 
made  relative  to  the  maintenance  required  to  maintain  the  IFC.MS 
TF41  engines  with  the  automated  system  and  without  the  auto¬ 
mated  system.  The  same  type  of  testing  is  going  on  at  Myrtle 
Beach  for  the  A10  TEMS.  This  study  is  predicated  on  the  util:: 
ation  cf  automatic  data  acquisition  of  engine  data.  It  does:.': 
deal  with  justifying  whether  vou  should  have  one  or  should  not 
have  one  . 

A1 :  One  significant  thing  I'd  like  to  point  out.  Many  of  these 

systems  which  exis  +  toda\  depend  upon  highly  accurate  PM I.  or 
maintained  instrumentation.  More  recently,  we've  found  out  that 
the  sensors,  even  though  they're  not  precision  sensors,  the  data 
that's  coming  off  them  is  very  repeatable. 

Cl:  So  the  trend  is  more  significant  than  the  actual  reading. 

Al:  Exactly.  Our  program  here  is  set  up  to  handle  the  trend 

rather  than  the  precision  thermodynamic  calculation. 

4 • -  Base  Status  Summary  (Figure  1  ) 

M:  The  first  display  that  you'll  be  seeing  is  a  base  statu- 

summary.  We're  indicating  on  the  screen  the  number  of  a  i  :\  :  a  :  :  . 
of  the  40  aircraft,  which  aircraft  are  fully  mission  cap.,''  la, 
partially  mission  capable,  not  mission  capable,  either  :  •  .  . 

of  supply  or  maintenance.  And  in  the  two  aircr.ft  that 
mission  capable,  there's  an  indication  of  a  hole,  i.au  . 
are  not  two  engines  installed.  For  the  engine:-,  w  '  : 
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at  76  installed  engines,  and  of  the  14  that  are  uninstalled, 

3  are  serviceable,  5  are  in  maintenance,  2  are  awaiting  main¬ 
tenance,  and  4  are  not  mission  capable  because  of  supply  prob¬ 
lems.  The  percentage  at  the  right  indicates  an  average;  of  the 
5  engines  that  are  in  maintenance,  approximately  54%  of  the  work 
is  complete.  If  you  were  to  look  at  a  summary  of  the  uninstalled 
engines,  it  would  tell  you  specifically  which  are  the  uninstalled 
engines  and  at  what  point  they  are  in  the  maintenance  process. 
There  was  a  major  alarm  on  engine  serial  number  P138,  indicating 
low  thrust.  That  engine  is  installed  in  aircraft  129.  A  minor 
alarm  is  indicated  on  engine  631.  There  are  5  engines  currently 
on  watch  status. 


A1 :  I  have  one  question.  Are  there  additional  pages  if  the 
alarms  and  the  watches  exceed  the  space? 

M:  There  would  be.  In  terms  of  the  engine  watch  status,  the 

only  indication  is  the  number  of  engines  on  watch  status.  There 
would  be  another  report  that  would  give  you  an  indication  of 
why  it  is  on  watch  status  and  some  other  summary  statistics. 
You'll  notice  we  use  the  category  new  alarms;  those  are  the 
alarms  that  have  occurred  since  the  last  update  of  the  data 
base.  If  the  age  of  data  were,  say  24  hours,  and  the  data 
base  was  updated  every  night,  based  on  data  from  the  day  before, 
we  would  not  have  much  more  than  4  or  5  alarms.  A  choice  might 
be  made  to  indicate  the  number  of  alarms  and  call  a  display 
that  would  explain  each  one  to  some  extent. 

Dl:  Question.  On  the  waiting  maintenance  and  ENMCS  there,  that 
percent  figure  you've  got,  whit  does  that  mean?  Are  we  talking 
about  maintenance  manhours  that  are  remaining  to  get  that  to 
1001,  or  what  hours,  what  maintenance  manhours  are  we  talking 
about? 


M:  For  management,  what  would  be  the  best  way  to  express  that? 
You  could  talk  about  a  job  that's  80%  done,  or  requiring  10  more 
manhours . 
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Dl:  To  me,  that  would  be  more  significant,  the  number  of 

manhours . 


Bl:  Manhour  backlog  would  probably  be  more  significant  rela¬ 

tive  to  maintenance,  and  relative  to  ENMCS,  I  would  assume  that 
possibly  a  calendar  period  would  be  more  specific. 

M:  Like  estimated  time  to  completion? 

Bl:  No,  estimated  deliveries,  more  than  anything  else. 

D2 :  But  where  would  that  information  come  from? 

Bl:  Well,  it  would  be  accessed  out  of  the  supply  computer. 

If  you're  addressing  engine  management  in  this  sytem,  you're 
going  to  have  to  have  the  ability  at  the  base  level  to  tie  into 
Ba  all  existing  programs. 

M:  Is  that  a  MMICS  capability  or  is  that  a  different  processor? 

Is  it  resident  in  the  Burroughs  computer  at  the  ! ase  It  .el? 

Bl:  No,  it's  in  the  1050  computer. 

Cl:  The  MMICS  and  the  supply  computer  are  two  separate  com¬ 

puters  . 

Bl:  But,  right  now,  don't  we  get  a  MMICS  plavuver  to  the 

supply  system?  Isn't  there  a  MMICS  program  that  gives  you  your 
due-outs  and  supply  status? 

Cl:  That's  on  the  supply  computer,  and  that's  Reel-24,  D18. 

Bl:  Yes,  D18,  I  know  is  the  supplv  computer,  but  I  thought 

there  was  a  MMICS  product  that  we  could  get  out  of  the  system 
that  was  a  tie  to  this,  whether  it  was  put  in  by  material  control 
Br  in  the  statusing  of  those  aircraft,  I  don't  know. 

L2:  That  information  might  be  there  or  it  might  lie  available 

with  input  from  the  system  here. 

M:  How  important  are  those  two  figures,  awaiting  maintenance 

and  the  ENCMS  percentages  in  a  summary  display  like  that. 
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Bl:  The  fact  that  we  have  AWM  should  probably  be  displayed 
in  the  probable  manhour  backlog  that  those  two  engine-  would 
incur.  In  other  words,  the  engines  were  removed  for  some 
cause,  whether  it's  a  scheduled  cause  or  an  unscheduled  cause; 
it  was  removed  for  that  cause.  There's  a  specific  path  of 
maintenance  that  one  would  run  through  to  solve  that  problem 
and  return  that  engine  to  serviceable,  which  has  a  standard,  a 
job  standard,  attached  to  it,  from  which  one  could  imply  a 
standard  maintenance  backlog  to  those  particular  engines . 

There  wouldn't  necessarily  be  a  standard  maintenance  backlog 
for  each  engine,  there  would  be  a  backlog  relative  to  the 
cause. 

L2:  Where's  that  information  now? 

Bl:  There  are  job  standards  for  specific  types  of  maintenance 
within  the  maintenance  control  complex. 

Cl:  That  percentage  number  is  a  number  that  the  branch  chief 
normally  uses  on  a  day-to-day  basis  to  give  him  his  overall 
status.  But  it  applies  more  to  specific  engines.  It  doesn't 
have  a  lot  of  meaning  when  you  group  them. 

M:  Okay.  So  you  think  manhours  on  an  overall  daily  display 

like  this  would  make  more  sense.  And  then  if  you  specifically 
looked  at  a  display  (as  we  will  later)  of  uninstalled  engines, 
then  gave  it  a  percentage  completed,  that  would  make  more  sense 
at  that  level? 

Bl:  It  would  be  a  management  tool  that  would  be  applied  to 
programming  the  next  day's  effort  or  the  following  week's 
effort,  or  whatever  like  that. 

M:  How  about  eliminating  60$  figure  altogether  on  the  ENMCS? 

Bl:  The  percent  ENMCS  doesn't  mean  anything  to  me. 

Cl:  What  he's  saying  is  that  on  an  average,  those  four  engines 
are  60$  complete,  ENORS .  I  think  what  you  really  want  to  know 


for  the  ENMCS  is  the  number  of  items  you  require,  and  their 
estimated  delivery  date.  Here,  you're  looking  for  "Am  I  in 
trouble  for  supply  delivery  dates,"  on  a  gross  look? 

Bl:  There  should  probably  be  an  overall  manhour  backlog  in 

work  or  removed  backlog.  In  other  words,  these  are  uninstalled 
engines;  three  of  them  are  serviceable,  the  backlog  assumed  for 
those  uninstalled  engines  is  the  following.  And  then,  specific¬ 
ally,  four  of  them  are  out  for  supply,  which  attaches  a  different 
principle  that  is  a  calendar  basis.  So  you'd  have  to  estimate 
when  the  status  would  change  on  a  calendar  basis.  Since  there 
are  four  different  engines,  I  don't  know  what  you  would  do. 

Cl:  Let  me  suggest  something.  From  a  management  standpoint, 

particularly  if  the  spare  line  happens  to  be  low,  it  would 
seem  to  me  that  the  two  AWM  engines,  for  example,  may  be 
relatively  minor  jobs,  but  there  is  a  manhour  figure  sitting 
off  to  the  side  for  those  that  may  dictate  that  you  work  those 
before  something  else. 

Bl:  Sure.  I  agree. 

Cl:  And  it  would  seem  to  me  that  you  would  want  to  know  the 

manhours  for  each  of  those  categories. 

Bl:  Right. 

M:  Okay.  The  suggestion  then  is  to  replace  the  top  two 

percentages  with  estimated  manhours  to  complete,  and  remove 
the  604  and  access  that  information  on  a  per  engine  basis. 

Bl:  The  other  thing  which  doesn't  seem  to  be  there  is  the 

following.  There  are  aircraft  that  are  down  for  not-engine 
reasons,  which  indicates  that  there  are  that  number  of  spare 
engines  available. 

M:  There's  an  indication  on  the  aircraft  that  are  down  for 

supply  and  maintenance,  that  you've  taken  those  four  engines 
and  placed  them  somewhere  else. 
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Cl:  On  the  malfunction  indications,  how  much  confidence 
do  you  have  in  those?  Frequently,  the  way  we  do  business 
today,  using  the  reports  we  have,  an  engine  will  come  into 
shop  for  a  suspected  problem,  and  in  the  course  of  mainten¬ 
ance  it  turns  out  to  be  a  completely  different  problem.  But 
that  initial  problem  remains  in  the  data  bank.  Is  this  derived 
from  that  same  kind  of  exercise? 

M:  This  is  a  new  alarm,  and  it  has  come  in  only  in  the  last 

update  of  the  data  base.  This  diagnostic  is  relatively  cer¬ 

tain;  in  other  words,  you  have  a  high  probability  of  being 
correct.  This  flags  things  that  are  really  bad.  Things  that 
are  degraded  may  be  in  the  gray  region  and  appear  as  performance 
types  of  information. 

Cl:  Okay,  it  will  be  less  specific. 

M:  Less  specific.  And  those  will  be  the  things  that  show  up 

on  a  watch  status.  We'll  see  a  couple  of  examples. 

Cl:  Again,  that's  really  key  for  planning,  because  if  the  guy 

doesn't  have  confidence  in  what  that's  telling  him,  he's  not 
going  to  use  it  or  if  he  does  us  it,  it's  going  to  detract  from 
his  overall  performance  because  he's  going  to  be  wrong. 

Bl:  What  would  be  the  impact  of  an  alarm  in  there?  Should  there 

be  an  indication  whether  those  few  particular  aircraft  are  sched¬ 
uled  for  an  event  within  the  next  so  many  hours?  From  a  manag- 
ment  standpoint  I  need  to  know  the  status.  It  should  flag 
that  during  the  interim  period  those  two  problems  were  found 
on  those  two  engines,  and  they  are  on  the  schedule  for  the 
morning's  flight.  Then  I  need  to  decide  whether  immediately 
I  must  get  someone  working  on  them  or  not. 

M:  Right  now,  how  is  that  flying  schedule  information 

available? 
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Bl:  It's  formulated  on  a  monthly  basis,  formulated  on  a  weekly 

basis,  entered  on  a  daily  basis,  and  revised  on  a  daily  basis. 

M:  How  accurate  is  the  monthly  basis? 

Bl:  Not  very.  It's  a  general  guess  because  it  takes  into 

consideration,  all  scheduled  events  that  may  happen  to  the 
aircraft  during  that  month's  period  coming  up.  So  it  drags 
them  off  the  schedule  at  various  times  to  allow  those  scheduled 
things  to  happen.  It  takes  into  consideration  the  unscheduled 
things.  The  weekly  schedule  defines  it  a  little  bit  better. 

And  then  of  course  the  daily  schedule  represents  what  is  actually 
happening. 

M:  Is  this  the  type  of  data  that  would  be  easily  available  on 

a  written  report,  or  should  that  be  accessible  within  the 
information  system? 

Cl:  The  difficulty  is  that  it's  not  in  the  computer  today  at 

all  locations.  ATC,  for  example,  uses  the  computer  to  schedule. 
TAG  and  some  of  the  other  commands  do  it  manually  via  written 
report,  and  it's  updated  daily.  But  the  point  is  well  taken. 

When  he  sees  an  alarm,  he's  going  to  go  to  the  flying  schedule, 
whether  it  comes  out  of  the  computer  or  whether  it's  on  a 
report,  to  see  when  he  has  to  work  that  problem. 

M:  But  again,  it  is  the  question  whether  you  think  that  infor¬ 

mation  should  appear  there,  or  manually  on  something  that  he 
would  normally  have  in  his  office. 

Bl:  This  piece  of  computer  information  will  do  away  with  a 

manual  procedure  which  currently  takes  us  a  long  time  to  per¬ 
form. 

M:  Would  you  say  that's  a  viable  candidate? 

Cl:  Yes,  you  may  not  be  able  to  incorporate  that  immediately, 
but  it's  certainly  something  to  look  at. 


4.3  Engine  Profile  (Figure  2) 


M:  The  next  display  is  the  profile  of  the  engine  with  the 

alarm.  We  talked  earlier  this  morning  about  the  infor¬ 
mation  chosen  as  candidates  to  appear  on  the  profile. 

B2:  "LAST  TRIM  -  OK"  -  What's  the  significance  of  this? 

M:  The  performance  data  is  used  back  through  the  T/0  spec 

to  predict  whether  you're  within  the  EPR  band. 

B2:  You  lost  me.  All  the  airplanes  flying,  trim  okay,  unless 
the  pilot  has  a  squawk.  So  this  one  comes  up  with  low  thrust, 
yet  the  TRIM  says  OK.  I  don't  get  the  significance. 

M:  You've  spotted  an  inconsistency  in  the  display.  TRIM  OK 

indicates  that  all  of  the  trim  parameters  are  within  bounds 
based  upon  the  last  updated.  This  particular  case  shows  low 
thrust,  so  TRIM  would  not  be  OK.  That's  a  mistake. 

B2:  Okay,  I  can  understand  that,  but  if  one  of  the  param¬ 
eters  is  out . . . 

M:  You'd  get  a  diagnostic. 

Bl:  I  don't  really  see  any  need  for  that  display,  period. 

M:  Why  not? 

Bl:  It  doesn't  tell  me  anything.  It  tells  me  the  same  things 
that  I  knew  when  I  got  the  alarm,  that  I've  got  low  thrust  on 
that  engine. 

M:  It  is  intended  to  be  a  summary  index  to  access  the  per 

engine  S/N  data. 

Bl:  The  only  thing  that's  significant  there,  as  I  see  it,  is 
a  core  engine  GPA  jump  of  -33t. 

M:  That  flags  the  next  display.  Now  you  go  in  and  say 

"How  much  is  that?"  and  it  comes  up  and  shows  you  specifically. 


gged  By  Alarm  Me 


Bl:  Okay.  I've  got  some  historical  data  that  I'm  not  sure 

I  need  because  I  haven't  made  my  decision  on  what  I'm  going  to 
do.  I  might  need  the  historical  data  if  my  decision  is  to 
pull  the  engine  out  now  and  work  on  it. 

M;  What  information  would  you  want? 

Bl:  Well,  I  know  that  the  fan  is  the  pacing  module.  I've 

got  an  HST,  1  and  2,  but  not  as  percent  of  TOT,  so  I  don't 
know  that  I've  crowded  HST  on  all  of  a  sudden  in  the  last 
little  bit.  It  doesn't  give  me  anything  there.  I've  got  an 
alarm.  I've  punched  a  button  that's  supposed  to  tell  me  what 
I've  got  to  do  next.  All  this  display  tells  me  is  that  I've 
got  to  punch  the  computer  again.  I'm  still  at  the  same  point 
I  was  when  I  read  the  alarm.  I  know  that  the  engine's  got 
low  thrust  and  I've  got  a  problem. 

Now  if  the  pilot  squawks,  and  he  had  EDS  on  board,  I 
assume  he  would  punch  out  the  EDS  to  get  a  picture.  Something 
told  him  he  had  low  EPR.  He  feels  in  the  seat  of  his  pants 
that  he  doesn't  have  thrust;  so  his  write-up  is  low  EPR,  and 
at  that  point  in  time  he  should  have  punched  the  EDS  to  say 
"take  me  a  reading  now,  because  something  I  feel  is  wrong  and 
I  don't  know  what."  So  that  reading  should  already  have  dumped 
into  your  machine  here  and  specifically,  the  machine  should  have 
answered  the  maintenance  people  saying,  "Hey,  here  is  the  reading, 
here's  what's  wrong." 

M:  That’s  the  problem.  There  are  many  causes  of  low  thrust. 

You  don't  have  suf f ic ient inf orma t ion  to  say  "I  have  low  thrust, 
and  specifically  the  problem  is  as  follows..."  We're  not  trying 
to  replace  the  maintenance  person  diagnosing  the  problem  in  the 
engine. 

Bl:  Principally,  this  is  a  history-type  of  a  system.  So  in 

effect,  what  I've  got  here  is...  supposedly,  this  is  not  Day  1 


and  this  is  not  the  first  entry  that’s  come  out  of  the  system. 
I’ve  got  some  history  back  of  me  there;  I've  got  a  low  thrust, 
low  EPR  write-up,  which  indicates  low  thrust  and  I've  got  a 
-  3 3"o  core  GdA  and  an  overall  drag  on  the  total  engine,  which 
I  don't  know  what  percent  that  core  is  of  the  drag.  In  past 
cases,  when  I've  seen  this  type  of  a  parameter  display  through 
EDS,  the  corrective  maintenance  action  had  been  change  an  FT1T 
probe.  So  specif ical ly ,  what  I  need  to  see  there,  more  than 
a  lot  of  historical  data  that  doesn't  tell  me  how  to  get  to 
the  basis  of  the  problem,  is  I  need  to  see  some  probabilities 
thrown  up  there  on  what  my  next  maintenance  step  should  be; 
and  then  you  turn  the  maintenance  guy  loose  to  do  his  diagnostic, 
following  the  best  possible  procedure  routine  that  the  computer 
Da  says  gets  me  fixed  and  back  in  the  air  fastest.  Sometime  during 
the  troubleshooting ,  he  may  stumble  across  something  which 
turns  this  thing  around.  Now  we  need  a  way  for  the  maintenance 
guy  to  access  the  computer  to  say,  "Hey,  your  logic  wasn't 
quite  correct,  because  in  this  instance,  doing  this  procedure, 

I  found  this."  And  that  goes  back  into  the  history  again;  and 
you've  created  a  new  file  under  low  thrust.  Or  else,  your 
system,  as  a  maintenance  management  system,  is  only  going  to  be 
a  typewriter,  and  it's  only  going  to  say,  "Hey,  here's  some 
useless  information,"  and  it  doesn't  drive  the  situation  at 
all. 

M:  The  idea  of  the  computer  diagnosing  the  problems  or  sup¬ 

plying  among  a  basically  infinite  set  of  possible  causes  of 
particular  problems,  a  group  of  probable  factors  is  a  problem. 
What  we  are  seeing  here  is  the  way  that  an  immense  amount  of 
historical  data  is  indexed.  The  reason  for  the  indexing  is 
that,  for  example,  the  screen  that  you  see  is  of  finite 
extent,  that  is  the  amount  of  information  that  can  be  put  on 
there  is  limited.  This  drives  a  hierarchy  of  information. 
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Bl:  What  I'm  trying  to  get  to  is  to  cut  down  on  the  amount  of 
stuff  that  is  on  the  screen  and  just  put  out  the  significant 
points  for  problem  solution  ...  drive  the  problem  solution. 


M:  We  had  a  version  of  that  in  the  survey,  which  was  a  dis¬ 

play  like  this  with  almost  no  information  on  it  and  basically 
the  information  that  was  displayed  was  only  the  excep¬ 
tion  information.  In  other  words,  you  have  a  listing  of  the 
things  in  the  data  that  were  abnormal.  Use  those  to  drive  the 
next  things  you  will  be  seeing.  The  overwhelming  response  on 
the  survey,  however,  indicated  that... 

Bl:  My  response  was  the  same  on  that  thing.  I  wanted  to  know 

everything. 

Cl:  I  think  that  for  the  purpose  of  formatting  the  data,  you 

are  pretty  much  constrained  to  going  in  this  manner. 

M:  That's  the  other  point  I  was  going  to  touch  upon;  that 

it  simplifes  the  data  system.  If  we  choose  a  given  format  of 
display,  it  will  solve  or  be  useful  in  acquiring  data  for  a 
wide  variety  of  problems,  in  this  case,  on  a  per  engine  basis. 
What  we  are  trying  to  get  at  is  a  single  display  that  we  can 
have  as  a  standard  item  --  a  standard  data  product. 

Cl:  Within  the  operational  environment,  I  think  what  he  is 

saying  is  that  he's  not  going  to  spend  any  time  on  this  chart. 

He  may  have  to  flip  it  and  he's  going  to  go  directly  to  the  next 
one.  If,  however,  instead  of  a  "LOW  THRUST"  it  simply  says 
"PERFORMANCE"  down  there,  he  may  spend  a  bit  longer  looking  for 
some  other  clues. 

Bl:  It  doesn't  key  me  to  my  next  action.  See,  just  because  I 

have  a  LCF  counts  on  a  core  does  not  mean  that  the  core  may 
be  close  to  a  scheduled  event. 

M:  Would  you  rather  see,  for  example,  remaining  LCF  to  an  event 

on  a  pacer  module  basis? 


D2 :  Either  that,  or  get  back  to  the  GPA  correlation  with  time 
and  cycles  . 


Bl:  I  don't  have  an  event  on  there  that  really  tells  me  what 

percent  of  the  net  GPA  the  core  has  affected.  This  is  my  main 
point  -  the  first  thing  I  flip  up  on  the  board  that  makes  the 
decision  on  what  to  do.  Am  I  going  to  call  the  guys  out  there 
to  troubleshoot  the  thing,  or  can  I  make  the  decision,  "hey, 

this  one  is  so  close  on  scheduled  events  and  on  all  other  param-  ‘ 

eters  to  go  into  hard  maintenance,  that  I  might  as  well  pull  it  | 

down  and  get  it  into  hard  maintenance  and  not  waste  AGS  effort."  J 

M:  How  about  adding  an  additional  column?  Another  column  j 

would  be  a  directing  action,  for  example,  to  access  to  the  GPA 

trend.  Under  the  PACER  LCF  or  TOT,  it  says,  "look  at  the  history  1 

of  the  time/cycles."  t 

Bl:  There  ought  to  be  a  lineup  --  "not  a  candidate  for 
immediate,"  or  "candidate  for  immediate  removal  based  on 
schedules"  and  then  you  go  in  and  you  pump  your  schedules 
button.  If  it  throws  up  what  you've  got  there,  you  automatically 
see  there  is  a  fan  coming  up  on  schedule,  a  gear  box  coming  up 
on  schedule,  and  this  core  is  rotten  for  some  undetermined 
reason.  That's  three  modules.  That  gives  me  the  authority  right 
then  and  there  to  take  a  transfer  action  of  that  engine  down  to 
the  depot. 


M:  How  about  displaying  an  item  that  directs  you  to  push  a 

button. 

Bl:  That's  what  I  mean.  You  don't  have  anything  to  drive  me 
to  the  next  input.  Now,  if  that  input  happens  to  be  3  letters 
and  a  number  that  I  have  to  punch,  then  that  input  out  to  be 
displayed  -  3  letters  and  a  number  -  so  that  the  guy  can  just 
punch  it  in.  He  doesn't  have  to  look  through  a  chart  to  figure 
out  what  three  numbers  he  needs  to  punch  next. 
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M:  That's  a  very  good  comment. 

Bl:  The  maintenance  status  that  I'm  looking  for  is  "What's 

going  on  today?"  I  don't  want  to  have  to  make  the  decision, 
the  decision  should  already  be  made  and  here  is  what  I  am  doing 
today . 

M:  The  real  requirement  that  it  lays  on  the  system,  is  that 

during  the  debriefing  or  prior  to  debriefing  the  aircraft  being 
squawked  is  down- loaded. 

Bl:  If  it  has  an  EDS  on  board.  Let's  just  not  assume  that. 

I  hate  to  assume  that  we  are  going  to  have  EDS  or  some  on-board 
unit  on  the  weapon  system. 

M:  In  that  case,  the  diagnosis  of  the  fault  has  to  be  made 

upon  data  prior  to  the  flight  and  pilot's  squawk.  There  is  no 
reason  that  could  not  be  done.  That  is  one  of  the  things  we're 
trying  to  establish.  Maybe  one  of  the  requirements  we  have  is 
that  located  in  the  vicinity  of  the  debriefing  area,  is  one  of  the 
terminals . 

Bl:  I  think  your  approach  at  each  level  within  the  base  is 

to  determine  what  has  to  be  done  and  tell  me  what  has  been 
done  already. 

D 1  :  I  think  we  have  already  made  the  assumption  that  the  EDS 
is  on-board  because  it's  right  there. 

Bl:  Instead  of  EDS  you  could  just  as  easily  have  EMS  there. 

M:  The  information  explained  here  is  for  an  FIDO  EDS  system, 

but  we're  not  constraining  it  to  anything  like  that.  What 
we  are  interested  in  is  the  items  of  information  that  should  be 
there  and  if  there  is  an  automated  turbine  engine  monitoring 
system  on  this  engine,  then  there  would  be  an  item  there  cor¬ 
responding  to  that,  if  there  was  not,  it  would  not  be  on  there. 


Dl:  I  don’t  see  the  significance  of  a  squawk  at  all.  There 

is  no  reason  for  a  squawk  because  if  he  has  the  EDS,  he  has 
an  indication  that  he's  got  low  thrust,  EPR  is  low.  He  punches 
the  button,  it  takes  all  the  recording  right  there  at  that  point 
and  time  and  when  you  dump  it,  down- load  it,  it’s  right  there. 
That's  where  you  really  need  to  start  pulling  apart.  Not  the 
fact  that  it  is  low,  but  how  low  is  it? 

Cl:  Keep  in  mind  that  this  data  is  going  to  be  used  in  a  number 

of  different  areas  in  maintenance  complex  and  you  and  your 
specific  job  may  not  use  everything  on  that  sheet,  but  I  may 
need  it  a  day  later. 

Bl:  Absolutely,  but  I  think  what  we  ought  to  try  to  do  from  a 
field  standpoint  is  to  address  problems  with  our  weapon  system. 
We’re  addressing  a  computer  system  to  help  us  manage  what  we 
do  on  an  airplane.  So,  you  have  to  really  start  your  thinking 
at  the  level  where  the  problem  occurs  first  and  then  figure  out 

all  the  management  aspects,  e.g.  when  does  this  guy  have  to  see 

this  daily  status  of  engines  and  what  should  be  on  it  relative 
to  when  the  event/problem  occurred.  What's  the  logical  sequence 
of  maintenance  events  after  an  event  occurs?  Well,  it's  going 
to  be  debriefed.  Then  some  decision  will  have  to  be  made  as 
to  whether  it  gets  work  now  or  gets  work  later.  Then,  when  it 
gets  work,  how  do  we  work  it?  What's  the  best  route  to  follow? 
What's  our  most  economical  route  to  follow?  Is  that  engine  so 
close  on  time  that  the  most  economical  route  is  to  pull  it. 

Those  things  would  have  already  occurred  before  this  maintenance 
control  officer  comes  in  and  punches  D  for  Daily  Status. 

Cl:  In  order  to  make  those  later  decisions,  you've  got  to  know 

what  the  problem  is  now.  Because,  even  though  you  may  be  within 
10%  of  the  core  limits,  if  you  don't  have  a  spare  engine,  you're 
going  to  fix  this  one  to  fly  on  that  10%.  What  I'm  talking 
about  is  the  decision  process  that  gets  you  there.  I  think  that 


the  decision  process  has  got  to  be  the  same  for  each  problem. 
Recognize  what  occurred,  what  the  cause  is,  then  what  you're 
going  to  do  about  it  based  on  all  of  the  data. 

Bl:  Now  let's  take  the  problem  as  it  occurs.  It  happened,  the 

pilot  reported  it,  it  goes  into  debriefing.  There  is  the  first 
place  we  need  some  information. 

Cl:  We  want  to  know  what's  the  cause  of  that  problem.  Then 

we  can  make  our  decision  as  to  what  to  do  about  it. 

Bl:  Here's  the  best  probable  route  to  take  based  upon  this 

engine's  history  and  the  current  problem  with  the  engine.  So 
it  gives  you  a  couple  of  routes  to  follow.  Here  is  the  point 
where  now  we  need  to  make  a  management  decision  and  it  has  to 
come  up  to  a  statusing  level. 

Cl:  I  still  don't  understand  that. 

Bl:  The  guys  down  in  debriefing  don't  see  the  big  picture  of 

the  wing.  They're  not  the  guys  who  make  the  decision.  They 
are  the  ones  that  input  these  little  points  of  information. 

They  troubleshot  this  system.  The  computer  told  them  the  best 
possibilities  based  upon  this  engine  and  this  problem  at  this 
point  in  time.  All  of  those  things  should  be  forwarded  to  the 
management  level. 

M:  Let  me  restate  this.  We  go  through  the  scenario  of  a 

squawk  during  debriefing  of  low  thrust.  There  might  be  a 
terminal  in  the  area.  An  entry  might  be  made  right  at  the  time 
of  a  pilot's  squawk.  From  that  point  on,  it  is  available  to 
anyone  else.  Further  displays  are  accessed  in  the  debriefing 
room  to  indicate  what  might  be  wrong.  If  it's  a  more  subtle 
problem,  there  might  be  other  management  decisions  that 
have  to  be  made,  it  might  be  deferred.  In  another  level, 
higher  up  for  example,  in  scheduling  maintenance  at  some  later 
time,  maybe  an  hour  later  or  half  a  day  later  someone  gets  this 
type  of  display  again,  and  he  can  go  in  and  look  at  all  the 
age  and  cycles  indexed  by  this  piece  of  information  and  then 


he  can  prescribe  his  maintenance.  We  are  trying  to  get  from 
you  guys  what  we  put  up  here.  What  pieces  of  information. 

We  will  come  up  with  one  display  updated  on  a  periodic  basis 
from  downloaded  EDS  data  or  from  a  pilot's  squawk  in  the  de¬ 
briefing  process,  manually. 

Bl:  The  displays  should  be  generated  for  the  level  that  the 
display  will  be  used.  And  they  also  sequence  themselves  in 
time  of  requirement  and  that  sequencing  of  events  should  drive 
you  to  the  logical  display. 

B2:  The  last  update  was  5  June  and  that  thing  was  output  b  June. 
Is  there  any  way  you  can  indicate  what  system  was  worked  or 
whether  it  was  an  04  (TRIM)  or  a  2300  (TURBINE  ENGINE)  work 
code  prefix.  Is  there  any  way  to  indicate  that  the  last  up¬ 
date  was  something  about  changing  a  fuel  pump  or  a  fuel  control 
or  whether  they  were  changing  a  clamp  on  the  oil  cooler,  since 
the  latter  has  no  relation  to  low  thrust. 

M:  "LAST  UPDATE"  refers  to  EDS.  The  maintenance  history  can 

be  accessed  with  another  display. 

Da  B2:  Is  there  any  way  to  show  evidence  of  acknowledgement.  If 
we  get  the  low  thrust  and  some  guy  decides  to  fly  the  airplane, 
can  we  get  a  signature  or  man  number  or  some  indication  that 
someone  saw  this? 

Bl:  He's  got  a  good  point  there  because  the  pilot  may  have 
written  up  low  thrust.  That  thing  up  there  says,  "Hey,  there's 
nothing  wrong  with  the  engine,  go  look  at  the  airplane." 

M:  The  display  indicates  low  thrust  was  squawked  and,  in 

addition,  the  performance  measurements  corroborated  it. 

Bl:  But,  a  331  may  be  within  the  acceptable  band  of  that 
particular  engine  and  there  ought  to  be  something  on  there 
that  says  "this  is  acceptable." 

Dm  Dl:  But  that  would  not  be  an  instantaneous  jump. 
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B2:  Is  there  some  way  to  show  if  this  is  a  flyable  condition. 

The  pilot  could  fly  with  low  thrust  all  day.  Should  we  drop 
one  750  lbs  and  let  him  go?  What  I'm  saying  is,  ideally  we 
have  a  known  fact  that  if  your  engine  is,  say,  2.1,  then  you  can 
fly  with  800  lbs  of  bomb.  If  it's  2.0,  you  can  fly  with  600 
lbs  of  bombs.  When  you're  looking  at  it,  it's  usually  a  TAB  B 
situation.  These  guys  are  coming  back  with  a  1-hour  turnaround. 
If  this  thing's  going  to  work,  it  has  to  make  money  for  us  in 
combat,  not  peace  time. 

M:  A  display  that  shows  no  diagnostics  would  indicate  a 

flyable  aircraft  even  though  some  of  these  events  occurred. 

This  system  is  resident  away  from  the  flight  line.  As  part  of 
the  EDS  system  there  is  a  flight  line  diagnostic  unit. 

31:  I  got  the  distinct  feeling  that  you  are  hung  up  on  EDS. 

The  program  ought  to  have  a  little  bit  of  looseness.  Don't 
get  hung  up  like  that. 

Mow  there  is  an  alarm  on  the  status.  The  guy's  next 
logical  thing  was  to  punch  this  display. 

M:  That's  right.  The  set  of  possible  failures  that  can  occur 

can  be  picked  up  at  the  flight  line  is  smaller  than  the  set 
of  all  possible  things  that  can  go  wrong  with  the  engine.  The 
pilot  in  debriefings  squawked  low  thrust  and  in  addition,  more 
detailed  off-line  processing  indicated  that  events  occurred. 

In  addition,  historical  events  are  brought  up  because  that's 
going  to  affect  what's  going  to  go  on  next  with  the  disposi¬ 
tion  of  the  aircraft. 

B2:  Do  I  have  to  detect  a  relationship  to  MADARS?  If  I  do, 

then  you  know  that  MADARS  is  really  a  neat  little  trick.  It 
does  a  lot  of  things  for  both  maintenance  and  AFl.C.  Why  don't 
we  ju'-t  take  MADARS  and  improve  it? 

M:  This  might  be  looked  at,  in  fact,  CEMS  might  be  looked 

at  as  the  next  generation  of  a  MADARS  concept. 


This  is  a  fresh  look  at  the  problem.  We’re  doing  a  systems 
analysis  study  of  the  user  requirements  not  specifically  tail¬ 
oring  a  system  of  software. 

4.4  Gas  Path  Snapshot  (Figure  3) 

M.  The  next  display  is  a  GPA  snapshot.  It  portrays  the  rela¬ 
tive  health  of  each  of  the  five  gas  path  modules,  and  their 
serial  number. 

Dl:  You  lose  the  cycles  on  the  HPT. 

M:  Would  you  prefer  to  have  that  rather  than  total  operating 

time? 

Dl:  On  those  two,  you  work  with  the  cycles. 

Ga  D2 :  What  they're  putting  up  there  is  a  gas  path  analysis. 
They're  hanging  their  hat  on  this  GPA  number  telling  us  more 
than  time  and  cycles.  There  may  be  a  correlation,  at  this 
point  unknown  and  unspecified,  but  what  we  are  looking  at  is 
a  GPA  number  which  goes  from  0  to  100,  a  100  being  fine  and  0 
some  severe  degradation  in  performance. 

Bl.  I  still  don't  feel  this  gets  me  to  a  decision.  I  see  a 
core  indicated  there  and  I  see  a  HPT  and  I  know  that  I've  had 
a  33%  jump  in  the  core. 

D2 :  You  had  a  core  performance  degradation  of  33%  from  the  last 

time  this  EDS  information  was  updated. 

Md  Bl:  From  what  I'm  looking  at  right  now,  I'd  say  I  just  FOD'd 
a  core. 

M:  That's  the  right  decision. 

Bl:  I  don't  see  that  there.  I  know  what  you're  trying  to  say, 

but  I  don’t  see  that  there  because  I  didn't  see  what  was  there 
Tr  before.  If  I  look  at  the  HPT,  that's  floating  along;  it  may 
have  been  floating  along  level,  but  I  don't  know  that. 
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MODULE  HEALTH  RATING 
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D2 :  One  of  the  other  things  is  that  with  a  system  like  this, 

counting  time  and  cycles,  if  you're  mixing  and  matching  modules, 
your  engine  has  to  be  instrumented  to  count  not  only  overall 
engine  cycles  but  module  usage. 

M:  You  see  the  advantage  in  having  a  base  level  historical 

data  base.  You  just  have  to  count  engine  cycles  and  accumulate 
them. 

D2  :  But  the  software  has  to  add  those  cycles  into  each  module. 

M:  The  base  processor  linked  to  the  data  base  has  module 

serial  numbers  and  catalogs  all  the  modules  which  are  then  up¬ 
dated. 

Bl:  Are  we  saying  here  that  I  either  have  the  bottom  GPA- 

snapshot,  or  I  have  the  top  module  health  rating: 

M:  Yes. 

Bl:  I  wouldn't  get  both  of  those  on  a  snapshot? 

M:  You  could  get  both. 

Bl:  If  I  wanted  to  trend  rather  than  to  look  at  a  GPA  snapshot 

in  the  bargraph  form  . . . 

M:  That's  coming  up  next  slide. 

Bl:  At  this  point  in  my  access  to  the  computer,  I  don't  want 

to  see  that,  because  I  don't  need  all  of  it.  I'll  need  it 
later  on  though. 

M;  At  some  point,  you  might  want  to  look  at  that. 

Bl:  I've  hit  the  computer  three  times  now  and  I  still  don't 

have  my  problem  answered. 

4.5  Gas  Path  Trend  (Figure  4) 

M:  The  gas  path  trend  correlated  with  maintenance  history  is 

shown  on  the  next  display. 
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Fiiiure  4  CPA  Trend 


D2 :  The  computer  sees  all  of  this  information  that  the  core  is 

the  lowest  and  it  should  automatically  just  spit  that  out  for 
you  instead  of  you  having  to  go  through  one  or  two  iterations. 

Bl:  Back  in  the  first  display,  I  already  had  it  figured  out 

that  it  was  FOD'd.  I  was  taking  it  for  granted  because  none  of 
the  other  modules  were  displayed  and  there  wasn't  some  other 
information  to  drive  me  to  another  module.  The  most  probable 
Tr  thing  that  I  had  was  a  FOD'd  core. 

M:  Then  you  would  not  have  needed  access  to  this  display. 

Bl:  You  have  to  take  a  look  at  who's  going  to  be  looking  at 

this  information.  Can  anybody,  at  any  level,  come  up  with  the 
right  answer? 

M:  You  indicated  that  you  can  do  it  from  this  one. 

Bl:  By  feeling  that  if  there  were  something  else  in  there  that 

should  be  presented,  the  thing  would  have  presented  it. 

D2:  You  would  see  it  in  the  GPA. 

M:  The  problem  with  having  the  computer  make  a  decision  is 

that  there  is  a  finite  probability  that  it  will  be  the  wrong 
Da  decision.  In  other  words,  we're  not  trying  to  replace  the  human 
in  the  loop. 

Bl:  I  understand  that,  but  this  is  an  access  thing.  Its 

availability  of  data  to  make  a  decision. 

B2:  Does  it  only  display  the  core  because  it's  less  than  501? 

M:  The  last  100  operating  hours  may  be  the  critical  interval 

and  you  might  specify  the  core  specifically.  Look  at  the  infor¬ 
mation  content  as  far  as  boot- strapping  these  displays  to  appear 
Df  automatically  or  to  appear  on  user  request.  Let’s  concentrate 
on  the  items  of  the  display  and  see  if  we  can  change  those  and 
worry  about  the  boot- strapping  operation  later. 
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Ga  Bl:  Again,  GPA  takes  in  what  parameters? 

M:  The  gas  path  analysis  is  done  with  the  performance  data  that 

is  acquired  with  the  TEMS. 

Cl:  It  will  vary  from  engine  to  engine. 

M:  Depending  also  on  how  the  modules  are  configured.  The 

module- directed  parameters  are  dependent  upon  the  modules. 

What  we  specified  here  is  a  100-hour  limit.  We  thought  that 
would  be  a  reasonable  interval  on  which  the  trend  automatically. 
You  could  ask  for  the  last  200  hours  as  well.  Would  it  make 
sense  that  the  last  100  operating  hours  on  that  core  would  be 
Ad  what  you  would  be  interested  in  looking  at? 

Bl:  The  thing  that  I  see  is  that  the  maintenance  actions 

indicated  are  relative  to  changes  in  the  trend. 

B3:  You  say  you  are  not  going  to  lose  any  of  those  maintenance 

actions  ? 

M:  No. 

B3:  How  often  should  the  trend  of  information  be  updated? 

What  are  you  talking  about  here?  You  should  update  every  time 
you  do  an  action  anyway. 

M:  That's  correct.  The  question  is,  does  it  make  sense  to 

do  it  that  way  or  can  it  be  done  less  often? 

B3:  My  question  is,  how  long  does  it  take  to  update  it? 

M:  The  information  is  fed  in  about  once  a  day.  The  trending 

procedures  are  something  that  require  computer  work,  especially 
if  you  have  a  large  number  of  engines  and  it  might  take  15 
Ad  minutes  of  computer  time  that  could  be  scheduled  in  easily  at 
2  o'clock  in  the  morning  if  it’s  an  automatic  process.  But 
on  the  other  hand,  if  you  only  did  once  a  week  it  would  require 
less  computer  resources  than  if  you  did  it  once  a  day. 
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Dl:  The  onboard  electronic  processing  unit  has  to  be  dumped 

periodically  into  the  DDU.  That  unit  can  only  hold  so  many 
engines  worth  of  data  before  it  has  to  be  dumped  into  a  perman¬ 
ent  storage. 

Tr  D2:  The  trend  data  gets  put  on  a  disk  where  we  can  print  it 

out.  In  fact,  the  trending  was  an  item  at  the  last  diagnostic 
meetings  which  got  quite  a  bit  of  attention.  One  of  the  items 
which  came  up  there  was  that  a  feasible  means  of  handling  the 
trend  data  would  be  via  some  type  of  compression  technique. 

You  would  only  take  a  look  at  the  individual  points  from  the 
last  so  many  hours,  whatever  that  may  turn  out  to  be.  You  could 
actually  look  at  the  points  for  each  individual  flight  and  all 
the  data  prior  to  that,  you  see  as  an  average  trend  for  those 
hours.  You  see  this  average  trend  and  then  look  at  your  indi¬ 
vidual  flight  points.  One  of  the  things  that  I  brought  up  at 
that  meeting  and  I'd  still  like  to  see  is  the  possibility  for 
Da  the  operator  to  look  at  a  particular  window  or  to  sort,  i.e.  to 
take  a  look  a  little  more  closely. 

M:  In  other  words,  go  through  all  the  data  and  pull  out  all 

the  take-off  points  or  whatever  by  window? 

D2 :  Yes,  that  type  of  flexibility. 

M:  That  flexibility  should  be  in  this  type  of  system.  Would 

you  suggest  that  the  people  in  the  maintenance  area  who  are 
doing  daily  type  work  would  use  that? 

D2:  People  in  the  shop  may  want  to  do  that. 

Bl:  There’s  another  thing  on  this  that  you  really  need  and  it 
goes  along  with  what  you  were  saying  here.  When  you  have  a 
malfunction,  it  could  correlate  with  the  type  of  mission  flown. 
Co  You  ought  to  keep  that  data  in  the  history  so  that  you  can  see 

if  there  was  a  trend  in  "type  malfunctions"  relative  to  missions 
flown . 
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M:  Do  you  mean  held  within  the  history  over  the  last  100 

operating  hours? 

Bl:  No.  For  example,  for  this  low  thrust  write-up.  If  he 

was  in  a  specific  mission  environment,  in  a  specific  spot  in 
the  envelope,  the  low  thrust  that  both  the  sensors  and  diagnos¬ 
tic  system  are  reporting  and  his  seat- of - the- pants  feeling  may 
be  perfectly  normal  operation. 

D2 :  What  you're  asking  for  here  is,  what  happened  during  that 

particular  flight  that  this  pilot  squawked. 

Bl:  The  fact  that  I'm  trying  to  make  is  when  I  got  that  331 

drop,  33$  GPA,  that  is  one  reading  that  I  formed.  Now,  if  I'm 
in  a  mission  that  has  by  its  environment  dropped  the  engine  to 
that  point,  that's  a  false  point  that  I'm  looking  at. 

M:  The  flight  point  that  produced  that  diagnostic  was  a 

stabilized  condition. 

Bl:  The  way  I  understand  EDS,  if  any  parameter  goes  out  of  an 

exceptable  range,  it  will  ring  up  the  system  and  snapshot. 

Cl:  That's  an  event  as  opposed  to  a  trend,  or  a  performance 

snapshot. 

M:  But  that  data  is  not  used  to  make  this  calculation.  The  only 

data  used  is  the  stabilized  performance  data. 

Bl:  So,  possibly  there  should  be  an  entry  in  the  first  display 

that  would  indicate  that  this  is  a  stabilized  data  point. 
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4.6  Watch  Status  (Figure  S) 


M:  We  discussed  the  concept  of  a  watch  status.  Here  is  a 

watch  status  report  where  five  engines  have  been  flagged.  It 
lists  their  location,  the  reason  for  the  flag,  current  GPA 
rating,  clicks  remaining,  the  pacer  module,  hot  section  time  and 
life  limits  occurring  during  the  next  100  operating  hours. 

The  reasons  used  to  flag  an  engine  on  a  watch  status  include 
a  deteriorating  trend  of  GPA,  vibration  jumps,  SOAP  trends, 
life  limits.  On  the  second  engine,  the  core  is  due  for  900  cycle 
maintenance  within  15  operating  hours.  A  large  jump  in  the 
gear  box  vibs  on  the  third  engine  suggests  monitoring  SOAP. 

The  fourth  engine  shows  change  in  the  SOAP,  i.e.  nickle  for 
that  particular  engine  over  the  last  20  operating  hours.  The 
fourth  has  low  performance  and  a  trended  GPA  dropping. 

D2 :  This  is  the  normal  data  that  you  are  feeding  in  to  the 

system  and  it  automatically  prescreens  it?  Is  this  a  separate 
data  input  that  gets  put  in  some  place  or  is  it  using  the  cur¬ 
rent  information  to  give  us  this  engine  watch  status? 

M:  If  you  flag  an  engine  for  being  on  watch  status  based 

upon  the  fact  that  it  had  a  lower  performance  . . . 

D2:  So  an  operator  would  have  to  say,  "I  think  we  have  an 

engine  here  that  we're  going  to  watch,"  and  then  he  has  to 
do  something,  and  the  system  will  track  it? 

M:  Very  much  like  a  SOAP  too,  which  says  if  the  metal  is  high, 

monitor  pre-  and  post-flight  and  watch  it.  Should  you  auto¬ 
matically  insert  it  into  watch  status? 

D2 :  A  person  reviewing  data  items  would  have  to  go  to  his 

terminal  and  input  a  serial  number  and  indicate  this  or  that 
reason? 

M:  We're  talking  about  automatically  putting  an  engine  on 

watch  status.  The  computer  would  make  the  decision. 
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figure  5  ling  i  ne  Watch  Status  Report 


D2  :  This  is  an  engine  watch  status  as  a  result  of  limit  exceed¬ 
ances  and  GPA  degradation  rates  and  it's  done  automatically 
or  it’s  not  done  automatically? 

M:  The  information  is  updated  automatically.  It  could  be 

flagged  automatically,  manually  or  both. 

Cl:  I  think  it  really  ought  to  be  done  automatically.  I 
would  prefer  to  see  it  separated.  Those  that  are  running  out 
of  life  on  some  parts  on  one  page  and  the  performance  problems 
on  another.  My  life- limited  parts  I  may  only  look  at  once  a 
week.  Per formance- or iented  problems  I  may  want  to  look  at 
daily. 

Bl:  What  you're  assuming  is  that  a  life  limit  drove  the  watch 

status.  I  would  not  assume  that  this  is  what  we're  doing. 

The  watch  status  could  be  driven  by  a  trend  of  0.5-o  per  oper¬ 
ating  hour  of  low  performance.  And  when  you  look  at  the  HS1 
and  HS2  you  would  see  that  you  have  bad  FTIT  problems.  If 
there  is  a  life  limit  in  a  very  short  amount  of  time,  can  you 
go  in  with  an  inspection  or  a  check  on  the  probes  and  still 
Md  keep  the  engine  running  or  should  you  go  in  there  right  now 

because  those  probes  are  beginning  to  show  the  wrong  reading  and 
you  are  burning  up  the  turbine  right  now. 

M:  The  watch  status  is  meant  to  be  the  categories  which  don't 

have  a  maintenance  action  required  immediately,  inspection  or 
anything  like  that,  but  which  maintenance  may  be  imminent. 

D1 :  You're  talking  about  cycles  over  there  in  the  pacing 

item  and  yet  when  you're  talking  about  life  limit,  your  talking 
about  hours.  What  do  you  do  when  you  have  x  number  of  cycles 
left? 

Bl:  This  is  one  thing  you  need  to  clarify.  If  the  intent  is 

Lu  to  display  life  limits  as  time  remining  in  engine  flight  hours 
then  it  should  be  so  stated. 
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Just  take  the  top  one  up  there.  Say  specifically  that 
the  engine  had  the  cover  plate  replaced  at  100  cycles,  so  you 
still  have  some  cycles  remaining,  and  that  equates  to  82  flight 
hours . 

That's  really  what  you're  trying  to  say  there,  but  its 
confus ing . 

D1 :  You  can  fly  the  aircraft  from  Holloman  to  Spain  and 

in  flight  refuel  it  five  times  and  only  create  one  cycle. 

M:  Yes,  we  are  using  the  engine  flight  hours  to  cycle  equiv¬ 

alence  standard  for  that  engine  that's  determined  for  the 
fleet  by  AFLC,  for  example,  the  FIS  is  1.37  or  something  like 
that . 

Bl:  I  would  not  like  to  see  that.  This  is  a  base  level  item. 

Your  computer  should  provide  the  average  cycle  equivalence 
for  that  particular  base.  They  are  all  different  and  the  1.15, 
which  is  the  number  you  are  searching  for,  is  so  erroneous 
it's  not  funny. 

M:  You  would  like  to  see  a  utilization  rate  which  is  base- 

specific  . 

Bl:  If  you're  trying  to  tell  me,  "I've  got  this  much  useful 

life  remaining,"  then  it  should  be  the  useful  life  at  that 
base.  Also,  the  watch  status  engines  should  reflect  the  air¬ 
craft  deployability. 

M:  Do  you  think  that  the  definitions  of  watch  status  is  that 

you  wouldn't  deploy  with  that  aircraft? 

Bl:  Well,  for  instance,  if  I  have  82  hours  remaining  that 

would  probably  pull  me  underneath  transfer  limits.  But  a 
person  normally  reviewing  watch  status  may  not  really  equate 
that.  I'm  asking  for  a  little  more  information,  like  an  asterisk. 
That  would  indicate  nondeployable . 


M:  Do  you 

Da  All:  Yes. 


think  that  the  watch  status  concept  is  a  good  idea? 
(Consensus) 


B2:  If  you  start  creating  these  data  products  which  forecast 

the  ability  of  wings  to  sustain  war,  like  how  many  airplanes 
can  we  send,  would  that  be  classified  output? 

Cl:  No,  because  these  are  only  recommendations  as  to  what  you 
would  want  to  do  with  respect  to  deployment  situation.  If  you 
are  out  of  airplanes  and  you  need  an  engine,  it  doesn't  make 
any  difference  what's  on  the  display,  you're  going  to  deploy 
it. 

M:  Parts  of  the  data  system  are  confidential  and  will  be 

secured  as  such. 

B2:  They  will  not  be  accessable  then? 

M:  That's  correct.  There  is  a  whole  series  of  security- 

type  requirements.  If  you  do  see  anything  in  any  of  these 
that  would  be  a  confidential  item  or  that  would  require 
security  protection,  let's  flag  it. 
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4 . 7  Engine  Profile  -  Trending  (Figure  6) 


M:  This  is  the  engine  with  the  performance  trend  dropping  about 

.5  percent  every  operating  hour.  You  can  look  at  the  trend  for 
the  last  100  operating  hours  at  various  intervals. 

B 1 :  This  is  more  consistent  with  what  we  would  like  to  see, 
i.e.  the  effect  of  the  problem  against  the  overall  trend. 

M:  Would  you  say  you  need  both  the  snapshot  and  the  trend? 

Bl:  This  display  gives  you  an  idea  of  the  maintenance  category 

the  engine  might  fit  into,  relative  to  scheduling. 

Cl:  Really  the  CPA  snapshot  indicates  to  you  which  modules  you 

want  to  test . 

Bl :  It's  helpful  to  have  both  of  them  up  there;  to  look  at  your 

overall  engine  and  the  module,  and  then  trend  what  you  want. 

Cl:  Can  we  see  the  HPT  and  the  core  against  each  other? 

M:  Yes,  that's  possible. 

P3:  How  is  the  net  GPA  different  from  the  individual  terms'1 

M:  It's  a  weighted  average. 

D3:  The  weight  pulls  mostly  on  the  core  and  the  high  pressure 

turbine? 

M:  Yes. 

Bl :  We  want  to  provide  some  information  for  the  guy  to  make  a 

decision  on  what  he's  going  to  do  in  the  engine.  There  is  enough 
there  to  say  the  HPT  is  going  downhill  and  the  core  is  following 
it.  Probably  the  best  thing  to  do  is  to  change  out  to  the  core 
and  HPT.  However,  what  I  don't  have  is  enough  information  to 
match  my  component  changes  with  other  available  parts,  to  get 
some  more  life  out  of  it.  So  maybe  another  call  to  the  computer 
would  give  you  an  economic  analysis  of  maintenance  on  the  engine. 
You  need  something  to  indicate  what  additional  TRIC's  to  run  to 
get  that  information.  It  should  give  you  the  economics  o!  t h i s 


maintenance  action:  do  I  want  to  let  it  continue  to  fly  out 
Om  its  82  hours  at  a  .5  percent  degradation  rate,  or  is  it  more 
economical  to  stop  that  deterioration  right  now,  because  I 
don't  want  to  burn  the  thing  out  completely. 

M:  What  units  do  you  measure  that  in? 

B1 :  You  would  measure  that  using  GPA  to  indicate  the  condemndat ion 

rate  is  going  from  21  to  50%  in  a  period  of  time.  That  still  leaves 
the  determination  to  fly  the  aircraft  out  at  the  DCM.  He  may  say 
he  can  afford  to  throw  parts  away  because  there's  more  economy  in 
flying  the  next  40  missions. 

M:  That's  an  excellent  suggestion. 

B1 :  You  should  have  a  border  line  across  251  or  whatever  that 

number  is,  to  indicate  this. 

M:  Suppose  I  swap  one  module,  how  does  the  GPA  recover?  Is 

that  a  useful  question  to  answer? 

Tn  Bl:  And  what  is  the  new  trend  for  the  next  100  operating  hours. 

M:  How  far  ahead  would  you  need  to  forecast? 

Fo  Bl  :  To  the  next  scheduled  or  life-limited  point  in  the  engine. 

M:  You  want  the  ability  to  run  that  for  a  number  of  different 
component  combinations? 

D2:  There  is  a  tremendous  amount  of  flexibility  in  that.  De¬ 

pending  upon  when  the  next  scheduled  event  is,  whether  it  is  a 
time/temperature  event  or  a  phased  inspection,  you  could  change 
Fo  something  that  would  still  keep  that  engine  on  the  aircraft  until 
you  get  to  a  phase,  and  fix  it  up  then. 

M:  You  must  know  when  the  next  event  will  occur. 

D2 :  You  know  when  the  next  hard  schedule  maintenances  are  going 

to  occur. 

M:  "Hard  schedule"? 


D-  46 


< 


D2 :  The  phases  and  those  types  of  activities.  You  know  when 
they're  going  to  schedule  the  aircraft  down  for  water  washes. 

You  can  correlate  time/cycles  to  parts  consumption.  If  we  know 
Ms  what  module  is  contributing  to  our  performance  degradation  and 
to  what  degree  the  various  modules  do  contribute,  the  question 
is:  "What  could  I  do  within  a  reasonable  period  of  time  to  keep 

that  engine  flying?"  Maybe  you  don’t  want  to  pull  out  a  whole 
core  or  compressor.  If  the  compressor  is  the  biggest  item 
contributing  to  the  performance  degradation  and  the  fan  is  also 
contributing,  it  may  be  easier  to  change  out  a  fan  than  to  change 
out  a  compressor.  That  could  change  your  GPA  to  an  acceptable 
level.  You  could  keep  the  engine  on  the  wing  for  another  100 
hours,  and  then  fix  it  up  at  its  phase.  You  may  have  prevented 
complete  engine  removal. 

M:  The  key  issue  is  the  integration  of  all  these  factors. 

D2 :  Previously,  they  would  have  pulled  the  engine  out  and  maybe 

Ga  sent  it  to  depot. 

4 . 8  Engine  Profile  -  Integration  (Figure  7 ) 

M:  The  next  display  looks  at  another  profile  of  an  engine  on 

watch  status.  This  engine  had  a  vibration  jump.  The  oil  analysis 
trend  shows  the  rate  of  change  in  parts  per  million  per  hour. 

That’s  a  little  bit  different  from  the  SOAP  charting  that  is 
normally  analyzed.  Comments? 

B3:  When  was  the  SOAP  taken? 

M:  It  would  have  been  taken  after  the  last  flight. 

Cl:  Why  did  you  choose  to  show  that  PPM/Hour,  rather  than  against 

the  established  guidelines? 


M:  A  lot  of  TO's  are  written  in  terms  of  PPM/Hour. 

So  D1 :  No,  just  parts  per  million.  It's  the  parts  per  million  of 
wear  metal  in  that  oil  that  you're  sampling. 

C2:  Time  is  only  a  convenience  for  trending.  It  is  strictly 
a  PPM. 

M:  If  you  had  a  certain  parts  per  million  level,  does  that 

specify  a  maintenance  action? 

C2 :  Yes. 

Bl:  There  is  a  flat  limit  on  parts  per  million;  also,  there  is 

a  limit  that  indicates  rate  of  rise. 

D1 :  You  have  a  trend  and  a  threshold.  There  are  two  different 
things  you  want  to  watch  in  SOAP,  and  those  are  the  trend 
and  the  threshold.  And  if  you  hit  either  one,  you  start  doing 
something . 

M:  Is  the  trend  parts  per  million  since  the  last  SOAP? 

C2:  One  of  them  is.  I  think  you  could  put  both  SOAP  displays 

on  the  one  chart. 

Dl:  On  your  F100,  for  some  reason  titanium  is  a  critical. 

C2:  You  could  plot  any  of  them,  but  you'd  have  to  be  able  to 

put  the  threshold  in  for  whichever  one  you  were  plotting. 

4 . 9  Sorting  (Figure  8) 

M:  The  next  display  demonstrates  sorting  engine  files  based 

Pa  on  a  serial  number.  This  might  be  used  for  locating  a  specific 

TCTO  completion  record.  The  columns  are:  serial  number,  status, 
location,  health,  trend  and  clicks  remaining,  pacer  module,  hot 
section  time  and  life  limits. 

Bl:  If  you  had  a  number  of  components  or  modules  that  were  coming 

up  on  life  limits,  would  they  just  continue  to  display  themselves 
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down  the  columns? 

M:  On  a  summary  display  there  would  be  an  indication  of  1. 

You  could  get  the  remaining  ones  displayed. 

Lu  B1 :  If  there  were  more  than  one  component  or  module  that  was 
coming  up  on  life  limit  you  should  put  a  TRIC  in  that  column, 
which  would  drive  the  guy  to  go  in  there  and  display  it. 

M:  Would  you  rather  have  life-limited  components  within  100 

hours  come  up,  or  would  you  rather  just  flag  a  continuation? 

Bl:  If  you  were  looking  at  a  base  that  had  180  engines  on  it, 

Df  what  percentage  of  the  engines  would  fly  into  the  status  monitor. 

I  know  you  could  roll  it,  but  would  that  be  the  thing  that  you 
would  want  to  do? 

Cl:  I  could  envision  circumstances  when  you  would  want  either/or. 

Bl:  They  put  the  biggest  life-limiter  up  there,  which  is  a  fuel 

pump.  They  put  a  TRIC  that  says,  "Now,  hit  that  TRIC  on  that 
engine's  serial  number,"  and  then  you  get  a  hard  copy  of  every 
component . 

B2:  Is  it  possible  to  get  a  number,  like  that  particular  engine 

has  five  life  items,  10,  or  20? 

Da  Bl :  That  might  be  a  better  way  to  go.  In  fact,  that  comment 
relates  to  every  one  of  your  presentations.  If  a  presentation 
drives  you  to  go  someplace,  give  him  what  he  should  enter  so 
that  he  doesn't  have  to  look  it  up  on  a  card  or  a  book  or  a  tech 
order . 

D2 :  Maybe  the  first  display  after  you  give  some  documentary 

information  would  be  index,  saying,  "Here's  what  else  is 
available." 

Bl :  No,  don't  confuse  him.  Just  point  him  in  the  right  direction. 

C2:  I  don’t  think  you  need  the  index-type  thing.  1  think  you 

just  need  something  there  that  says,  "Hey,  you  got  this  information. 
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If  you  want  more,  punch  A-2  or  whatever."  Just  give  the  guy 
what  he  needs  to  know,  because  he  doesn't  want  to  keep  going  back 
to  an  index. 

Bl:  He  ought  to  line  the  cursor  up  under  life  limits  and  then 
hit  the  TRIC  and  go  forward.  Limit  the  number  of  entries  the 
guys  have  to  make. 

D1 :  If  we  have  a  wing  of  72,  we're  talking  about  160  engines. 

Are  we  going  to  have  a  roll  capability  on  this? 

M:  Yes. 

Bl:  Let  me  throw  one  at  you.  Can  the  computer  analyte  the 

maintenance  that  has  been  performed  on  an  engine  build,  to  come 
up  with  an  indication  that  this  engine  is  past  economical  main¬ 
tenance?  In  other  words,  if  this  engine  keeps  displaying  problems, 
and  keeps  forcing  us  to  do  maintenance  on  it,  over  and  over  again, 
that  is  when  we  have  reached  the  economical  limit.  We  want  to 
send  the  whole  engine  back  to  get  it  completely  restructured. 

D1 :  Let  me  address  that.  OCM  is  going  to  look  at  that  engine 
and  only  fix  those  things  that  need  to  get  fixed  to  bring  it 
back  up,  and  you're  going  to  get  it  right  back. 

Bl:  Absolutely,  and  I  think  that's  a  good  way  to  go  about  it. 

But,  if  we  get  an  indication  that,  "Hey,  we've  reached  a  point 
where  this  engine  is  completely  wasting  our  money  and  wasting 
your  time,  becasue  every  one  of  those  components  is  going  to 
come  back  to  you  and  get  recycled."  It's  just  a  non- economical 
engine.  We  need  to  alter  that  build  in  some  way  or  another.  You 
know,  that  type  of  analysis  against  the  engines  to  say,  "Hey,  guy, 
you're  just  spinning  your  wheels  on  this  engine,  pull  it  out  of 
there  and  do  something  with  it." 

4.10  Grouping  Capabilities 

M:  The  next  set  of  displays  shows  the  health  of  a  squadron  at 
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one  point  in  time  (Figure  9).  You  would  be  comparing  the  current 
Gr  healtli  with  the  health  at  another  point  in  time.  It  is  a  snapshot 
comparison  between  the  two  dates  (Figure  10). 

B2:  The  range  would  be  in  GPA? 

M:  Yes,  in  this  case,  we  are  looking  at  performance. 

D1 :  Something  else  I'd  like  to  see  would  be  the  left  and  right 

engines  alongs ide  one  another. 

M:  The  capability  would  exist  to  do  a  snapshot  on  any  subset. 

For  example,  a  snapshot  of  left  engines  on  the  left  side  and  right 
engines  on  the  right  side. 

Bl:  I'm  trying  to  figure  out  what  that's  telling  me.  What  am  I 

going  to  use  that  for? 

B2:  You'd  probably  use  that  up  at  headquarters  to  see  if  the  guys 

are  washing  the  compressors  down  at  the  local  base. 

D2 :  No,  you  can  use  that  at  the  squadron. 

Cl:  That's  just  to  look  at  fleet  performance. 

B2 :  Well,  I  wouldn't  need  that  down  in  the  AGS. 

Bl:  It  doesn't  show  me  movement  in  performance.  It  doesn't  tell 

me  how  many  total  hours  I've  flown,  it  doesn't  display  the  sorties 
flown,  it  doesn't  display  the  type  of  sorties  flown. 

D2:  It  tells  you  squadron-wise  you've  had  a  significant  degrada¬ 

tion  of  performance  over  the  period. 

Bl:  Is  that  significant  or  is  that  normal  for  what  I've  been  doing 

with  those  airplanes?  That's  what  it  doesn't  tell  me.  It  just 
gives  me  some  numbers  and  I  don't  know  what  to  do  with  the  numbers. 

M:  Going  into  this,  you  will  have  some  knowledge  of  the  mission 

being  flown,  in  terms  of  total  operating  time  or  sorties. 

Bl :  Cumulative  missions  on  any  group  of  aircraft--it  needs  a 


D-  53 


BASE  STATUS  MONITOR 


figure  9  Grouped  Display  Show  Squadron  Health  (79  JUKI;  5) 
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Figure  10  Grouped  Display  Comparing  Current  Health  Rating 
(79  JUNIi  5)  to  Past  Performance  (79  APR  19) 


computer.  I  could  never  be  that  knowledgeable. 

M:  The  question  is,  is  there  a  function  that  this  display  could 

address.  Does  anybody  have  a  use  for  this  display? 

Ms  B1 :  There  is  a  use  relative  to  scheduling  the  remaining  life  in 
your  fleet,  if  you  knew  what  the  levels  were  related  to. 

M:  What  do  you  mean? 

Bl:  Suppose  I  did  air-to-ground  missions  during  the  period.  When 

I  started  I  knew  the  performance  or  health  of  my  fleet.  Afterwards 
the  health  of  the  fleet  has  deteriorated.  I  still  have  life  left 
remaining,  and  I  need  to  know  how  much.  By  changing  the  mission 
that  I'm  flying  next  month,  I  could  take  advantage  of  this  knowledge. 
Fs  It  also  gives  me  data  that  I  would  use,  to  determine  that  I'm  getting 
a  lot  of  engines  that  are  going  to  be  coming  out  for  maintenance  all 
at  once.  I  want  to  do  something  now  to  segregate  these,  and  find 
out  which  are  falling  under  that  category  so  I  can  not  fly  some,  or 
fly  some  faster.  That's  the  type  of  information  you  could  use,  but 
there  is  just  not  enought  to  direct  me  to  ask  the  computer  the  right 
thing . 

B2:  Is  there  any  information  available  on  each  engine  snapshot? 

M:  Yes,  but  you'd  have  to  go  through  36  of  them  and  tabulate  them 

to  find  out  that  your  whole  fleet  was  going  downhill. 

Bl:  From  something  like  this  display,  my  next  TRIC  would  give  me 

a  movement  in  time.  In  other  words,  where  do  those  figures  fall  at 
a  particular  point  in  time?  I  need  to  know  where  all  my  work  is 
going  to  hit  me,  at  what  point  in  time. 

M:  The  next  display  (Figure  11)  is  a  bargraph  representation  of 

the  same  information. 

Bl :  I  can  use  the  information  at  MAJCOM,  but  not  at  squadron. 

Df  M:  We've  actually  got  those  coming  up  later. 

D2 :  I  would  say  that  from  a  readiness  point  of  view,  which  is 
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Figure  11  Rargraph  Display  of  Squadron  Degradation 
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what  everybody  actually  is  talking  about,  this  is  important  to 
look  at. 


4.11  Ranking  Capabilities 


M:  The  next  display  (Figure  12)  shows  a  rank  of  all  engines  on 

a  nonstandard  attribute,  ranking  all  fans  whose  total  operating 
time  lies  between  certain  limits.  Standard  pieces  of  information 
and  information  on  the  fan,  serial  number,  etc.,  are  obtained. 

B3:  Why  do  you  need  delta  TIT? 

M:  It  is  used  in  the  standard  presentation.  You  may  not  use  all 

of  those  pieces  of  information. 

B2:  Can  you  put  the  title  on  these  displays? 

M:  Indicating  what  was  sorted?  Okay.  That's  it... 

B2:  All  the  Airmen  First  Class  will  be  doing  this  thing. 

M:  Looking  at  the  next  display  (Figure  13),  you  want  to  rank 

your  engines  according  to  joint  health. 

B1  :  When  Plans  and  Scheduling  comes  down  with  some  recommendations 
and  you  have  the  ability  to  look  at  this,  you'd  like  to  see  it. 

B3:  Yes,  but  the  DCM  makes  the  decision. 

M:  But  somebody  needs  to  know  that  there  is  a  900  cycle  core 

due  in  82  flight  hours. 

B1 :  You’ve  been  looking  at  Langley  AFB ,  right? 

B3:  They  do  that  all  the  time;  they  swap  engines  out. 

B 2 :  We’re  scheduled  for  deployment,  then  we  say,  "Hey,  we  have 
to  change  this  one."  You're  going  to  take  away  our  most  effective 
way  of  changing  cores. 

M:  Would  that  capability  make  sense? 

All:  Yes.  (consensus) 
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B2 :  This  is  going  to  pinpoint  pilots,  too. 

l 

Dl:  I  don't  know.  You  could  have  one  sick  one  and  one  good  one 

and  you're  going  to... 

C2:  Swap  engines. 

Bl:  Explain  JOINT  GPA . 

M:  It's  an  average  of  the  two  engines  installed  on  the  aircraft. 

Ga  Bl:  My  only  suggestion  would  he  to  take  a  look  at  the  ;  icing  GPA. 

You've  got  a  pacing  module,  now  display  a  pacing  GPA. 

M:  What  about  eliminating  HST° 

D 1 :  That's  the  first  time  it  has  come  up,  so  evidently  there's  , 

nobody  in  this  room  that's  really  concerned  about  it. 

Bl:  HST?  No  sir. 

1 

Lu  D2 :  The  parts  -  track ing  people  are  interested  in  that. 

Bl:  No,  that's  a  diagnostic  TRIC. 

Dl:  My  comment  is  that  I  haven't  head  any  comment  about  HST. 

Bl :  It's  a  diagnostic  tool,  rather  than  a  limiting  tool. 

M:  It's  correlated  to  the  current  HPT. 

Bl:  You  don't  need  STATUS. 


M:  Those  engines  and  aircraft  are  all  fully  mission-capable. 

D2 :  JOINT  GPA  does  disturb  me.  You  just  take  two  numbers  and 

average  them. 

M:  It's  just  used  for  ranking. 

Bl:  Why  not  use  the  JOINT  GPA  without  displaying  it" 

D2  :  I  don't  think  JOINT  GPA  is  a  valid  number  base  on  the  theor  . 

M:  You  don't  want  to  deploy  an  aircraft  with  one  good  engine  and 
one  degraded  one. 

D2 :  I  think  your  probability  is  greater  of  doing  that  by  ceroir.g 

in  only  one  GPA  figure. 


D- ol 


M:  Rank  them  by  JOINT  GPA,  but  don't  present  it.  Let  the 

people  look  at  each  GPA  separately. 

Cl:  One  other  point,  before  you  decide  to  eliminate  the  STATUS 

column.  It's  not  inconceivable  that  you'll  have  airplanes  with 
excellent  GPA  but  which  will  need  fire  control  work  for  weeks. 

M:  There  are  other  reasons  for  not  being  FMC. 

Cl:  If  nothing  else,  it's  a  source  of  good  engines. 

Bl:  Yes,  it  is  a  source  of  good  engines. 

M:  The  next  display  (Figure  14)  shows  the  status  of  uninstalled 

engines  . 

Bl:  Instead  of  a  SUPPLY  column,  put  in  a  MAINTENANCE  AND  SUPP! Y 

problems  column. 

Cl:  Or  just  PROBLEMS.  The  percentage  number  doesn't  have  any  real 

relevance  unless  you  know  about  the  job,  i.e.  in  terms  of  planning 
how  long  it's  going  to  be  before  it  comes  through. 

M:  You  want  an  indication  of  the  problem? 

Bl :  Yes,  is  it  a  waiting  maintenance.  Of  the  three  there  might 

be  long  or  short  ones. 

B2:  In  the  ENMCS ,  I  feel  you  need  that  documented.  You  should 

interface  with  the  supply  computer.  This  would  be  perfect, 
especially  for  uninstalled  engines.  Why  should  the  guy  have  to 
go  to  three  or  four  different  computer  products  to  get  the  whole 
story?  If  we're  going  to  use  this  BASE  STATUS  MONITOR,  then  I 
think  you  ought  to  equip  the  system  to  handle  the  supply  docu¬ 
mentation.  The  ENMCS  is  119  data  product.  You  should  print  out 
supply  document  number. 

Bl :  Make  a  separate  TRIG  to  display  document  numbers. 

M:  By  document  number,  is  that  the  part  number  for  supply’’ 

Bl:  It's  the  requisition  number  for  that  supply  problem. 

B2:  You  definitely  need  those,  so  you  can  say  it’s  40°  ENMCS. 
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Status  of  Uninstalled  Cnpincs 


I’  reality,  it  may  only  be  10^  as  far  as  completing  the  engine; 
ii's  901  built-up.  It  has  10®  to  go,  but  it  has  eight  parts  on 
order.  All  these  parts  are  minor  parts,  that  can  be  put  on  within 
3-4  hours,  whereas  another  engine  will  only  need  two  parts  but  it's 
way  inside  the  engine  and  the  whole  engine  is  being  held  up  for 
them.  So  if  you  really  want  to  help  that  guy  out,  you  need  those 
supply  documents. 

M:  This  morning,  we  eliminated  the  percentage  on  ENMCS . 

Cl:  You  don't  want  to  eliminate  it  in  this  case,  because  it 
tells  me  where  that  engine  is  in  the  maintenance  Cycle. 

Bit  But,  again,  you  don't  know  what  maintenance  cycle  it's  in, 
so  40®  is  relative  to  nothing. 

Cl:  We'll  know  what  the  problem  is. 

Bl:  The  supply  problem  is  the  existing  problem.  You  wouldn't 

have  the  maintenance  problems  built  up,  yet. 

Cl:  The  estimated  man-hours  to  complete  is  more  significant 
than  the  percent. 

Bl:  That's  right.  It's  the  backlog  that  will  exist  when  you 

get  the  supply  problem  satisfied.  You  still  don't  know  when  the 
supply  problem  will  be  satisfied.  The  other  computer  has  that 
informat  ion . 

M:  By  giving  the  requisition  number,  you  could  access  that  part? 

Bl :  So,  if  it's  a  supply  problem,  we  don't  need  to  see  third- 

stage  turbine  disk.  What  we  need  to  see  is  "six  parts  fPP  1  June." 

Cl:  You  need  to  display  only  the  parts  that  are  problems.  You 

may  have  40  parts  on  order,  but  you  may  have  satisfactory  delivery 
dates  on  30  of  them. 

M:  Okay. 

Cl:  And  as  far  as  the  percentage  versus  man-hours,  1  don't  think 

it  makes  a  lot  of  difference.  Be  aware  of  how  the  units  are  doing 
today.  The  shops  I've  been  associated  with  deal  in  percent  complete 
And  if  you  go  to  man-hours,  you  may  be  imposing  another  task  on 


r 


them  to  keep  that  current. 

M:  Does  anybody  from  Langley  AFB  look  at  it  in  terms  of  percent 

complete? 

B3:  We  always  consider  work  order  status  in  percent.  The  only 

time  it’s  different  is  when  you're  figuring  a  backlog  for  TAC. 

Cl:  If  you  know  what  the  problem  is,  and  you  know  what  the  per¬ 
centage  is,  that  automatically  translates  to  man-hours. 

B2:  I  think  400-1  (AFM  400-1)  and  also  the  other  Regs  specify 

in-shop  cause  in  percentage;  when  you're  rating  the  engine  as 
far  as  how  close  it  is  to  being  FMC,  it's  in  percentage.  And 
when  we're  talking  about  problems  at  a  given  base  at  command 
level,  we're  talking  about  man-hours. 

M:  So,  at  this  level,  the  percent  would  be  acceptable  if  you 

specified  the  problem? 

B d :  Yes,  if  you  specify  the  problem. 
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4.12  Deployment  (Figures  15  and  it>) 

The  next  group  of  displays  will  address  deployment. 

This  capability  was  originally  envisioned  as  a  command 
level  function  for  multiple  based  deployments.  Survey  results 
indicated  it  should  be  a  base- specific  function.  You  go  through 
a  procedure  that  would  be  the  same  as  making  your  own  decision. 
Any  comments? 

Bl:  Any  time  you  put  that  thing  in  a  computer-accessible  area, 

you're  going  to  have  to  make  sure  your  whole  computer  area  is 
secure . 

M:  It  would  list  (Figure  16)  based  on  joint  GPA,  your  eligible 

aircraft.  We  indicate  that,  based  on  the  condition  of  these 
engines,  you  should  bring  four  spares  along  and  you  are  shown 
two  additional  engines  to  replace  those  that  have  life- limited 
parts . 

Bl:  I  have  to  know  what  parameters  the  comrut  or  was  making  the 

decision  on.  They  may  not  be  the  same  parameters  that  we  would 
make  that  decision  on.  It's  good  information  to  have. 

M:  Would  you  prefer  this  method  or  tine  procedure  shown  in 

Figures  13  and  14,  i.e.  ranking  the  «ng  uu.s? 

Cl:  I  think  that's  the  whole  point.  This  display  is  redundant. 

M:  Does  it  make  sense  to  provide  a  deployment  planner? 

Would  there  be  any  payoff? 

Bl:  Knowing  the  rationale  that  went  into  it,  how  you  reached 

those  specific  numbers,  would  make  it  more  acceptable. 

M:  This  is  a  computerized  decision  process  and  it  ma>'  not 

he  entirely  accurate. 

Bl:  Most  deployments  require  a  configuration  of  an  airplane, 

so  the  airplane  tail  number  gets  set.  period.  h-m  should  :  -.rut 
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the  aircraft  tail  numbers  and  possibly  some  alternatives.  The 
Md  output  would  be  engine  information  as  we  have  here;  can  we  do 

that  deployment  with  what  we  have  installed  in  those  airplanes; 
if  not,  here  are  suitable  substitute  engines. 

M:  If  you  are  going  to  deploy  10  aircraft,  you  get  a  listing 

of  10  that  will  go? 

Bl:  The  type  of  mission  you  are  being  deployed  for  may 

generate  the  tail  number  of  the  aircraft,  depending  on  what 
avionics  are  on-board.  You  may  not  have  too  much  choice  of  the 
aircraft  you  deploy.  Now  we  have  to  go  into  a  planning  situa¬ 
tion.  We  have  to  know,  "Will  those  engines  last  on  those 
deployed  aircraft?" 

M:  The  inverse  video  could  indicate  areas  where  you  should 

look  further? 

Cl:  Does  the  fact  that  those  aircraft  tail  numbers  are  listed 

there  imply  that  they  ;ip'  fully  mi  s  s  i  on- capab  1  e? 

M:  Yes. 

Cl:  I  see  an  awful  lot  of  problems,  particularly  since  the 

FMC  status  changes  hourly.  1  have  a  lot  of  trouble  with  that. 
Md  I'd  end  up  resorting  to  the  manual  system.  I'd  probably  want 
to  go  through  and  look  specifically  at  engines. 

M:  As  it  was  in  the  first  two  displays? 

Cl:  Yes,  after  I  selected  my  aircraft  tail  numbers,  look  at 

the  engines  in  those  airplanes  to  see  whether  they  were  accept¬ 
able  for  the  de p 1 ovmen t . 

1 .  1  ;>  Ma  i  n  tenanc  e  To  r  eca  s  t  s 

The  next  display  is  a  monthly  report,  based  on  accumula¬ 
tion  of  time  and  cycles.  You  would  be  interested  in  forecasting 
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to  an  estimated  removal  date.  This  display  correlates  with  the 
general  health  of  the  engine  (Figure  17). 

B3:  What  is  the  margin  on  that  GPA? 

M:  Type  of  limit?  Based  on  the  current  health  and  the 

degradation  at  a  particular  rate,  we  predicate  the  unaccept¬ 
able  performance  date.  It  is  difficult,  without  operational 
experience,  to  set  a  margin.  That  prediction  is  based  on  the 
current  time  and  on  the  trend.  It's  a  prediction.  If 
the  usage  rates  of  the  engines  significantly  change,  it  will 
be  wrong. 

Bl:  Can  you  examine  your  whole  fleet  as  percentages;  which 

are  affected  by  cores;  which  are  affected  by  fans;  which 
are  affected  by  components? 

M:  Do  you  want  this  in  time  and  cycles  as  well  as  health 

degradation? 

Bl:  Time/cycle  degradation.  If  you  have  a  bell  curve,  you 

know  what  percentage  for  any  period  of  time  is  going  to  be 
driven  by  fans,  cores,  HPTs,  and  components. 

M:  Would  it  be  used  more  at  a  command  level  or  at  a  base 

level? 

Bl:  I  can  see  it  being  used  at  all  three  levels:  depot,  base, 

and  command.  It's  a  different  scope  at  each  level. 

M:  What  is  the  forecast  interval? 

Bl:  Six-month  forecast  is  the  standard  you  should  go  to. 

The  depot  would  rather  see  something  like  a  two-year  forecast. 

Cl:  Can  we  call  it  up  that  way?  Can  I  ask  for  all  engines  that 

arc  going  to  come  up  for  cores0 

Bl:  Any  time  there  is  information  like  this,  you  can  go  m  on 

any  single  element. 


B1 :  What  we  should  be  able  to  do  is  go  from  any  direction  we  '  : 

want,  like  cores,  and  what  percentage  of  cores  are  going  to 
come  out  for  time,  cycles,  and  for  degradation. 

M:  How  about  a  tabular  list? 

B 1 :  I  don't  think  for  planning  purposes  that  tabular  gives 

you  information.  I  don't  say  do  away  with  tabular.  An  addi¬ 
tive  to  your  tabular  information  would  be  a  graph,  a  distri-  l> 

button  over  time.  r1 

•  .5 
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M:  That  capability  is  one  that  is  essentially  available,  f. 

it's  a  matter  of  how  it  would  be  implemented.  j 

I  ; 

B 1  :  I  can  do  it  now  on  the  existing  computers.  ' 

M:  This  display  (Figure  IS)  correlates  GPA-predicted  removals  ’  1 

t 

with  the  time/cycle  removals. 

D3 :  Is  the  primary  reason  for  the  engine  being  displayed,  the  j 

trend  in  the  GPA  calculation? 

M:  If  you  had  a  very  high  GPA  but  it's  falling  very  rapidly, 

you'll  predict  that  you  are  going  to  need  maintenance  sooner. 

D 3 :  What's  the  breakoff  point? 

M:  This  is  a  forecast  of  when  it  will  reach  the  point  when 

it's  going  to  need  maintenance. 

D3:  Say  you  had  an  engine  with  a  high  GPA,  a  new  engine  out  of 

depot,  with  something  rapidly  going  and  it  was  going  down  -.3“ 

per  operating  hour.  Would  that  come  in  here?  -j 

M:  Yes,  it  would  appear  as  an  early  removal  data,  even  though  j 

it  was  a  new  engine;  that  would  flag  it.  ‘j 

Bl:  Something  like  that  though  should  be  flagged  as  an  alert. 

M:  Yes.  If  the  GPA  is  changing  greater  than  some  rate  or 

if  it  jumps  between  two  measurements,  that  triggers  a  watch 


status. 
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D3:  What  kind  of  limits  are  fixed?  For  instance,  I  think 

you  may  have  a  -  .  3°s  without  any  problems.  We  had  that  with 
newly  overhauled  engines. 

B1 :  You  can  display  this  as  a  total  fleet  average  percent¬ 

age  in  degradation.  In  other  words,  101  of  the  fleet  degrades 
at  21  per  hour.  You  can  track  it  over  the  months  to  find  out 
the  environmental  effects  and  mission  scenario  effects  against 
particular  degradation. 

D1 :  If  you  had  a  norm  or  an  average  there  in  that  trend.  .  . 

M:  The  trend  is  based  upon  a  series  of  data.  It's  not  the 

slope  between  the  last  measurement  and  this  measurement. 

Hd  B 1  :  I  hope  that  history  starts  at  Day  1  and  continues  tr-vn 

Day  1.  T  hope  it  doesn't  end  at  Day  30  and  start  all  over  agair 

M:  The  real  question  is,  "How  do  I  do  this  for  a  fleet  ot 

engines?"  You  have  to  look  at  an  operational  fleet  of  engines 
and  monitor  them  for  awhile  to  look  at  an  operational  fleet 
of  engines  and  monitor  them  for  awhile  to  get  some  experience 
on  the  threshold  levels  and  what  the  levels  of  a  healthv 
engine  are  vs.  an  unhealthy  one. 

Bl:  That  probably  is  good  from  a  base  standpoint.  When  you 

move  it  up  to  a  command,  I  couldn't  afford  to  go  through  every 
engine  that  I  own  and  try  to  look  for  trends  or  even  have  them 
Df  ranked  by  trend  or  ranked  by  CPA.  What  I  need  to  have  dis¬ 
played  is  percentages  of  movement  over  the  total  or  a  period 
of  time.  I  would  like  to  know  what  I  was  doing  with  that  por¬ 
tion  of  the  fleet  during  that  span  of  time  that  generated  that 
t  rend . 

M;  Is  that  a  depot  or  command  level  monitoring  function.' 

Bl:  It  would  be  a  command  monitoring  function  and  it  would 

be  an  interest  item  at  depot.  If  they  could  phase  their  pro¬ 
curement  to  the  cycles  of  events  ... 
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L2:  We  need  two  years. 

Bl:  I  really  need  forecasting  ability  for  something  like 

that.  You  just  need  to  change  it  around  a  little  bit.  I 
would  like  to  add  cumulative  GPA  movement  within  mission 
type  flown. 

M:  So,  for  example,  on  P-168,  which  would  be  in  with  a  num¬ 

ber  of  other  engines  that  were  flying  the  same  mission  there 
would  be  a  column  that  indicates  a  drop  at  -SI  per  hour  while 
the  rest  of  the  population  is  dropping  at  -1%  per  hour. 

Bl:  That  would  flag  the  individual  engine  relative  to 

experience . 

M:  That's  a  good  suggestion. 

Bl:  In  the  command  level,  it  would  also  allow  us  to  fore¬ 

cast  the  drop  out  that  we  should  expect  if  we  fly  that  scenario 
in  an  undeployed  area. 

4.14  Monthly  Distribution 

M:  The  next  display  (Figure  19)  shows,  on  a  monthly  basis,  the 

distribution  of  all  the  engines  assigned  to  a  base.  You  can  look 
at  the  particular  engines  within  each  bar  on  the  next  display 
(Figure  20) . 

Bl:  For  this  type  of  a  status,  I  don't  see  any  reason  to 

have  clicks.  I  don't  need  to  see  location.  You  need  to  see 
cycles  or  hours. 

M:  In  terms  of  a  component  that  was  pacing? 

Bl:  No.  Do  you  have  an  overall  chart  that  gives  the  pacing 

module  and  gives  you  the  serial  number  of  the  engine? 

M:  Yes,  one  response  is  that  this  type  of  display  is  not 

app  rop  r iate . 
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Bl:  We  don't  have  a  display  that  says  installed  engines' 

health,  however,  we  have  data  on  other  displays  that  give  us 
Df  installed  engines'  health.  Based  on  the  question,  I  would 

like  to  see  an  indicator  of  whether  it  was  spare  or  installed. 

M:  You  are  only  looking  at  the  health  of  your  installed 

engines . 

Bl:  I  would  like  to  see  the  pacing  cycles  or  hours. 

M:  We're  trying  to  search  for  a  group  of  items  that  can  be 

provided  over  and  over  again.  We  can  implement  a  significantly 
more  complex  set  of  capabilities  if  we  do  that. 

Md  Bl:  I  don't  think  we're  getting  complex  enough  for  these 
questions . 

Cl:  Let  me  ask  you  (Bl)  a  question:  what  would  drive  you 

to  look  at  the  right-hand  side  of  the  screen0  What  would  be 
the  reason  for  doing  that? 

Bl:  To  find  out  what  is  causing  my  installed  engine  health 

to  be  as  it  is.  I'd  want  to  see  that  in  the  overall  fleet. 

And  I  think  depot  would  like  to  see  that,  too,  because  they 
Df  are  trying  to  figure  out  what  they  should  be  supporting  in 

their  production.  More  cores  this  month  or  more  cores  for  the 
next  half  year?  Or  maybe  we  should  plan  on  fan-drive  turbines. 

Cl:  If  you're  going  to  look  at  this,  there  are  other  things 

you  want  to  find  out.  How  long  you  can  leave  it  installed? 

When  are  you  going  to  have  to  do  something? 

Bl:  Presented  on  that  display  should  he  an  indicator  of 

goodness,  acceptable  goodness.  That  chart  doesn't  have  any 
movement  to  it.  It  is  just  a  totalling  chart. 

M:  By  movement,  do  you  want  to  see  what  it  looked  like 

last  month? 
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Bl:  The  month  before,  the  present  and  four  months  out  or 

something  like  that.  A  period  at  a  time  to  be  specified,  but 
Fo  we  should  be  able  to  look  at  that  past  performance  and  we 

should  be  able  to  take  a  look  back  at  our  requirements,  i.e. 
if  I  am  required  every  month  to  enter  my  training  plan  or 
flying  program,  then  you  should  be  able  to  forecast  the  CPA. 
Since  you  know  what  I'm  flying  and  you’ve  got  a  history  to 
sav,  "If  you  fly  that,  GPA  deteriorates  by  that  percent." 

M:  That  could  be  done  based  upon  sufficient  amount  of 

historical  data  from  previous  flights  of  that  mission. 

Bl:  Can  you  track  the  removals  based  upon  performance? 

In  other  words,  I  flew  x  number  of  sorties  or  x  number  of 
flying  hours  and  I  have  had  so  many  removals  for  cause,  for 
schedule  pulls,  and  for  unscheduled  problems.  I  am  forecasting 
this  as  we  go  out  because  I  know  I'm  going  to  fly  this  amount 
of  hours  and  this  type  of  sorties.  The  result  would  be  the 
Gr  number  of  unscheduled  engine  removals  per  thousand  flight 

hours  and  the  number  of  scheduled  engine  removals  per  thousand 
flight  hours. 

M:  Would  that  be  appropriate  at  the  base? 

Bl:  It  would  probably  be  more  appropriate  at  the  command 

level,  but  I  still  think  it  C3n  be  used  at  base  level  because 
not  everybody  at  command  is  smart  and  people  like  to  ask  the 
bases  what  they're  doing.  So  the  guy  down  there  has  to  have 
the  answer  and  the  easiest  way  is  to  give  him  that  information. 

Fo  B2:  The  propulsion  chief  forecasts  engine  removals  with  a 

formula  that  is  already  in  existence.  They  predict  the 
number  of  unscheduled  removals.  There  is  a  factor  for  doing 
that.  You'll  be  touching  base  with  something  that  is  already 
in  existence. 

Bl:  But  it  could  be  done  a  little  bit  better  because  now  he 

knows  what  kind  of  flying  we  are  going  to  do.  The  forecasting 
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we  have  been  doing  has  been  so  erroneous  that  it's  not  funny. 

We  don't  seem  to  be  able  to  match  the  forecast  with  the  actuals. 


M:  How  far  are  you  off? 

Bl:  Significantly,  sometimes  you  are  on  the  line  and  other 

times  you  float  around  50%. 

M :  Do  you  need  80%  accuracy? 

Bl:  Of  course,  you  would  need  better  than  that.  Bases  have 

really  not  looked  at  this  type  of  forecasting.  They  will 
forecast  on  general  trend  for  six  months.  They  can  do  this 
by  knowing  the  schedule  requirements.  Based  upon  flying  this 
airplane  as  it  has  flown  and  based  upon  the  fact  that  the  engine 
doesn't  come  out  because  of  something  else.  There  are  two  vari¬ 
ables  here,  the  forecasting  of  a  schedule  on  an  engine,  and 
saying  that  engine  will  never  break  so  it  can  meet  its  schedule. 
Then  he  is  forecasting  unscheduled  events.  He  knows  there  is 
going  to  be  x  number  in  a  month.  But  that  is  not  based  upon 
what  he  is  flying  nor  is  it  based  upon  the  type  of  flying  that 
month. 

M:  The  in- fl ight- acquired  performance  data  can  make  a  sig¬ 

nificant  impact  on  the  forecasting. 

A1 :  You're  touching  upon  seme  really  significant  stuff  here, 

if  we  can  possibly  categorize  the  flight  data. 

Bl:  In  February,  TAC  standardized  the  mission  codes.  Now, 

we  are  flying  a  specific  maneuver,  or  training  to  a  specific 
maneuver;  what  changes  between  places  is  the  envelope  which 
you  are  flying  in.  This  base  at  5,000  feet;  this  base  is  at 
sea  level.  This  range  is  50  miles  away;  that  range  is  "00 
miles  away. 

M:  That  analysis  is  appropriate  to  the  central  data  base 

analys is . 
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A1 :  The  data  is  going  to  have  to  be  tagged  with  the  mission 

that  was  actually  flown. 

B 1 :  That  stuff  is  in  the  computer.  There  is  something  in  the 

6510  recording  system  in  the  MMICS  computer,  carried  in  the 
DOE  report. 

D2 :  How  are  you  going  to  get  that  mission  code  if  you  are 

Ba  going  to  automate  all  this?  How  does  that  black  box  know  what 
kind  of  mission  is  being  flown?  You're  collecting  raw  data 
off  the  sensors  of  the  aircraft.  The  black  box  is  collecting 
this  information. 

Bl:  One  of  the  blocks  is  the  flight  number. 

D2 :  You  get  a  flight  number,  but  the  aircraft  may  have  three 

or  four  missions.  Somewhere  you  have  to  hang  the  mission  in 
that  box  to  go  along  with  the  rest  of  the  data. 

M:  If  you  have  the  flight  number,  don't  you  know  the 

mission? 

D2 :  No.  What  I'm  saying  is  that  you  have  to  get  that  into 

the  box. 

M:  The  box  is  the  data  acquisition.  We  have  data  coming 

in  from  the  TEMS  and  data  coming  in  from  MMICS. 

Fs  D2:  I  don't  see  it  occurring  as  obviously  as  you  do. 

Cl:  It  is  keypunched  in. 

D 2 :  That  is  what  I'm  saying.  Here  we  are,  collecting  this 

information  automatically,  now  we  are  going  to  rely  upon 
critical  data  which  is  manually  entered. 

Cl:  That  is  how  the  pilot's  flight  time  is  maintained. 

That  is  going  to  be  done  regardless  of  whether  we  use  that 
information  or  not. 
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D2:  I  just  feel  uncomfortable  because  I  see  a  problem  develop¬ 

ing.  You  are  taking  data  and  somehow  later  on  trying  to  capture 
what  type  of  flight  that  was;  whether  it  was  in  training  or  a 
gun  run  or  a  bomb  run  or  something  else.  You  are  going  to  take 
raw  data  and  hope  that  it  gets  into  this  system;  I  just 
don't  see  it  going  into  place  that  easily. 

Bl:  I  thought  that  the  on-board  box  was  going  to  interface 

with  the  pilot  mission. 

B2:  You  are  going  to  have  to  access  the  sytem  at  the  de¬ 

briefing  area  or  in  maintenance  control. 

M:  The  diagnostic  system  should  catalog  the  time  on  tbe  engine, 

flight  number,  and  so  forth  so  this  kind  of  correlation  can 
be  made. 

D2 :  The  base  schedules  a  flight;  let's  call  it  flight  1  on 

tail  number  111.  He  is  going  to  fly  a  mission  at  8  o'clock  in 
the  morning  and  he  is  given  a  mission.  That  aircraft  records 
flight  1  and  picks  up  some  raw  data.  Unless  that  box  knows 
Fs  the  type  of  mission,  I  don't  think  you're  going  to  pick  up 

somewhere  down  stream  that  at  8  o'clock  tail  number  111  flew 
this  type  of  mission.  I  don't  see  that  happening. 

Cl:  You  don't  think  that  it  will  go  back  to  the  base  computer 

for  access? 

D2 :  You  should  input  the  mission  then  and  there,  i.e.  flight  1 

is  a  training  mission  and  tag  it  at  that  point.  We're  trying 
to  follow  those  data  products  at  Myrtle  Beach  now  and  it  is  very- 
difficult  . 

M:  What  we're  here  to  determine  is  the  data  requirements. 

The  data  interfacing  requirements  are  the  next  step.  How  you 
actually  do  this  would  be  part  of  the  design. 

Bl:  I  think  it’s  there  anyway. 
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4.15  Depot/OCNi  Functions  (Figures) 


M:  The  primary  depot  requirement  considered  was  performing 

on  condition  maintenance.  To  specify  maintenance,  you'll  be 
given  certain  pieces  of  information.  There  is  profile  infor¬ 
mation  (Figure  21)  that  would  be  similar  to  the  base  engine 
profile.  The  profile  indexes  which  subsystem  summaries  to 
access  . 

Those  of  you  who  have  experience  with  OCM,  would  there 
be  any  difference  in  the  profile  information  that  you  would 
Oc  want  here. 

Dl:  The  thing  that's  giving  them  difficulty  now  is  the  lack 

of  documented  history,  i.e.  what  maintenance  actions  took  place 
or  what  decisions  were  made  at  base  level  to  send  the  engine 
back  and  the  maintenance  history  that  went  along  with  it. 

B2:  How  helpful  were  those  TREs? 

Dl :  Very  little. 

M:  What  about  the  AFTO  781E  form? 

_im  Dl :  The  781Es  are  gone.  If  they  could  get  a  data  product 

containing  the  781E  data  it  would  be  useful. 

B 1 :  We  have  the  computer  product  on  a  781E,  it's  just  a 

matter  of  the  base  transferring  it.  It  has  to  be  done  and 
all  781Es  except  for  pacer  engines  will  be  on  there. 

M:  The  data  product  would  be  run  off-line  and  it  would 

look  exactly  like  a  781E? 

Ar  Bl:  There  will  be  no  hard  copy  on  a  781E.  The  ” 8 IE  data 

should  be  transferred  to  the  computer  when  the  engine  comes  to 
depot.  Any  changes  that  they  make  in  the  components  at  depot 
must  be  input  to  the  computer  against  that  S/N.  When  the  engine 
goes  back  to  the  base,  the  computer  transmits  the  information 
and  it's  already  re  -  in i t ia 1 i zed  in  the  base  computer. 

There  really  is  no  paperwork  to  be  done. 
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D1 :  We  put  our  337s  and  our  TRE  listings  on  a  big  table.  We 

have  a  planner,  a  scheduler,  a  production  guy,  a  quality  control 
guy,  and  our  engineer  representative.  They  sit  around  the  table 
Df  and  they  look  at  these  documents.  Each  has  a  vote  as  to  what 
they  want  to  do.  What  we  would  like  to  have  is  some  small 
product  like  the  781E.  You  could  reproduce  it  easily.  If  you 
could  get  it  into  a  five  or  six  part  document  so  each  man  could 
have  it.  They  are  all  going  over  the  same  material  at  the  same 
time.  They  make  the  decisions  and  then  they  press  on  to  the 
next  one.  We  do  four  or  five  of  these  a  day.  When  you  see 
four  or  five  cores  on  an  engine  or  maybe  two  engines,  this 
takes  a  lot  of  time. 

M:  What  about  the  AFTO  95  form  (significant  history)? 

Hm  Bl:  By  the  time  the  new  system  comes  out,  they  will  be 

automated. 

M:  By  automated,  someone  at  the  base  level  will  sit  down 

at  a  terminal  to  key  it  in'? 

Bl:  The  history  will  be  divided  into  the  module  and  accumu¬ 

lated  to  a  total  engine.  TCTO  data  is  necessary  for  San 
Antonio  ALC  and  whether  the  base  shipped  the  TCTOs  with 
the  engine.  (Figure  22) 

Ar 

B3:  Depot  should  like  this  system.  We  wouldn't  have  to 

ship  any  paperwork  at  all. 

M:  Yes,  that's  possible.  Now,  you  might  want  to  display 

the  bar  graph  representation  of  relative  GPA  for  all  the 
modules  (Figure  13)  and  the  trend  information. 

Bl:  There  should  be  a  second  display  under  the  GPA  snapshots 

indicating  cycles-  hours,  and  limiting  components  within  a 


Df  module.  That  would  tell  them  how  far  to  go  on  the  OCM. 


GPfi  SNRPSHOT 


The  base  would  like  the  display  when  they  got  the  engine  from 
San  Antonio. 

M:  The  next  display  (Figure  24)  shows  trended  information. 

In  this  case,  the  net  over  the  last  100  operating  hours, 
correlating  recent  maintenance  history.  Trended  Oil  and  Vibration 
data  are  shown  on  another  display  (Figure  2S) . 

Dl  :  That's  for  engines.  Are  you  going  to  have  a  similar 

display  for  core  GPA? 

M:  Yes,  in  the  same  format. 

Hm  B 1 :  I  think  they  also  need  the  1S34  (AFTO  1534  form)  data 

that  the  engine  went  out  under. 

M:  The  removal  reason? 

B1 :  Yes.  You  should  run  a  back  history  of  1534  on  that 

particular  engine  or  module. 

Dl  :  The  last  entry  on  your  95  (AFTO  95)  is  the  reason  why 

it's  being  shipped  back  to  depot. 

B 1 :  The  engine  manager  in  the  MA  area  has  been  known  to  go 

into  the  1534  system  and  change  the  reason  for  removal. 

He  selectively  does  this  primarily  when  we  have  removed  an 
engine  for  cause,  e.g.  the  turbine  blew  out.  However,  the 
OCM  team  is  going  to  pull  TCTO's,  so  he  changes  the  reason  for 
the  removal  code  to  TCTO.  You  know  what  that  does  to  us? 

It  makes  our  unscheduled  removal  rate  very  inaccurate. 

M:  This  concludes  this  discussion  for  today's  meeting. 
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